Downloads · 30 days
26
16% of all-time downloads
Qwen2.5-Coder-32B-Instruct_exl2_4.0bpw
Dracones/Qwen2.5-Coder-32B-Instruct_exl2_4.0bpw
Qwen2.5-Coder-32B-Instruct_exl2_4.0bpw is a text generation model from Dracones. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a 4.0bpw EXL2 quant of Qwen2.5-Coder-32B-Instruct
All-time downloads
166
Public
Repo size
17.8 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors17.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Dec 1, 2024
- Updated
- Dec 1, 2024
- SHA
- 0d88e293
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen2.5-Coder-32B-Instruct - EXL2 4.0bpw
This is a 4.0bpw EXL2 quant of Qwen2.5-Coder-32B-Instruct
Details about the model can be found at the above model page.
EXL2 Version
These quants were made with exllamav2 version 0.2.4. Quants made on this version of EXL2 may not work on older versions of the exllamav2 library.
If you have problems loading these models, please update Text Generation WebUI to the latest version.
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- apache-2.0
- Languages
- en
- Created
- Dec 1, 2024
- Updated
- Dec 1, 2024