Downloads · 30 days
7
5% of all-time downloads
Qwen2.5-32B-Instruct-3.5bpw-exl2
DrNicefellow/Qwen2.5-32B-Instruct-3.5bpw-exl2
Qwen2.5-32B-Instruct-3.5bpw-exl2 is a machine learning model from DrNicefellow. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This is a 3.5bpw quantized version of Qwen/Qwen2.5-32B-Instruct made with exllamav2.
All-time downloads
153
Public
Repo size
15.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors15.8 GB · 100%
At a glance
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Sep 19, 2024
- Updated
- Sep 19, 2024
- SHA
- 67e97308
Base models
Model card
From the Hugging Face model README
This is a 3.5bpw quantized version of Qwen/Qwen2.5-32B-Instruct made with exllamav2.
License
This model is available under the Apache 2.0 License.
Discord Server
Join our Discord server here.
Feeling Generous? 😊
Eager to buy me a cup of 2$ coffe or iced tea?🍵☕ Sure, here is the link: https://ko-fi.com/drnicefellow. Please add a note on which one you want me to drink?
- Type
- qwen2
- License
- apache-2.0
- Created
- Sep 19, 2024
- Updated
- Sep 19, 2024