Downloads · 30 days
19
5% of all-time downloads
Mistral-Small-3.1-24B-Instruct-2503-int4-awq-ov
Gapeleon/Mistral-Small-3.1-24B-Instruct-2503-int4-awq-ov
Mistral-Small-3.1-24B-Instruct-2503-int4-awq-ov is a text generation model from Gapeleon. Use it when you need the model to write or continue text. It is set up for transformers.
OpenVINO quant of mistralai/Mistral-Small-3.1-24B-Instruct-2503
All-time downloads
392
Public
Repo size
25.9 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin12.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- mistral
- Access
- Public
- Created
- Apr 7, 2025
- Updated
- Apr 8, 2025
- SHA
- 4daa7619
Try a prompt
Base models
Model card
From the Hugging Face model README
OpenVINO quant of mistralai/Mistral-Small-3.1-24B-Instruct-2503
Requires 16GB VRAM eg. Intel Arc A770
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- Created
- Apr 7, 2025
- Updated
- Apr 8, 2025