Downloads · 30 days
32
42% of all-time downloads
Qwen2.5-Coder-32B-Instruct_exl2_4.5bpw
Dracones/Qwen2.5-Coder-32B-Instruct_exl2_4.5bpw
Qwen2.5-Coder-32B-Instruct_exl2_4.5bpw is a text generation model from Dracones. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a 4.5bpw EXL2 quant of Qwen2.5-Coder-32B-Instruct
All-time downloads
76
Public
Repo size
19.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors19.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Dec 1, 2024
- Updated
- Dec 1, 2024
- SHA
- f0a54385
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen2.5-Coder-32B-Instruct - EXL2 4.5bpw
This is a 4.5bpw EXL2 quant of Qwen2.5-Coder-32B-Instruct
Details about the model can be found at the above model page.
EXL2 Version
These quants were made with exllamav2 version 0.2.4. Quants made on this version of EXL2 may not work on older versions of the exllamav2 library.
If you have problems loading these models, please update Text Generation WebUI to the latest version.
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- apache-2.0
- Languages
- en
- Created
- Dec 1, 2024
- Updated
- Dec 1, 2024