Downloads · 30 days
29
14% of all-time downloads
Qwen1.5-32B-Chat-5bpw-exl2
DrNicefellow/Qwen1.5-32B-Chat-5bpw-exl2
Qwen1.5-32B-Chat-5bpw-exl2 is a text generation model from DrNicefellow. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This is a 5.0bpw quantized version of Qwen/Qwen1.5-32B-Chat made with exllamav2.
All-time downloads
206
Public
Repo size
21.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors21.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- qwen2
- Access
- Public
- Created
- Apr 5, 2024
- Updated
- Apr 6, 2024
- SHA
- 1ca4b780
Try a prompt
Model card
From the Hugging Face model README
Qwen1.5-32B-Chat-5.0bpw-exl2
This is a 5.0bpw quantized version of Qwen/Qwen1.5-32B-Chat made with exllamav2.
To run this, make sure you installed the up-to-date version of Exllamav2.
License
This project is distributed under the Tongyi Qianwen LICENSE AGREEMENT. See the LICENSE file for more information.
Feeling Generous? 😊
Eager to buy me a cup of 2$ coffe or iced tea?🍵☕ Sure, here is the link: https://ko-fi.com/drnicefellow. Please add a note on which one you want me to drink?
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- other
- Created
- Apr 5, 2024
- Updated
- Apr 6, 2024