Downloads · 30 days
0
Qwen2.5-0.5B-Instruct-EXL2-4bits
Volko76/Qwen2.5-0.5B-Instruct-EXL2-4bits
Qwen2.5-0.5B-Instruct-EXL2-4bits is a text generation model from Volko76. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model is based on the Qwen2.5-0.5B-Instruct model and is quantized in 4bits in the EXL2 format using the AutoQuant system : https://colab.research.google.com/drive/1b6nqC7UZVt8bx4MksX7s656GXPM-eWw4
Access
Public
Updated Apr 27, 2025
Repo size
1.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.2 GB · 98%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- Nov 3, 2024
- Updated
- Apr 27, 2025
- SHA
- 8ba846ba
Base models
Model card
From the Hugging Face model README
Qwen2.5-0.5B-Instruct
Introduction
This model is based on the Qwen2.5-0.5B-Instruct model and is quantized in 4bits in the EXL2 format using the AutoQuant system : https://colab.research.google.com/drive/1b6nqC7UZVt8bx4MksX7s656GXPM-eWw4
You can learn more about the EXL2 format here : https://github.com/turboderp/exllamav2 Feel free to use it as you want
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Languages
- zho, eng, fra, spa, por, deu
- Created
- Nov 3, 2024
- Updated
- Apr 27, 2025