Downloads · 30 days
35
9% of all-time downloads
MarsupialAI/Qwen1.5-32B-Chat_iMatrix_GGUF
Qwen1.5-32B-Chat_iMatrix_GGUF is a text generation model from MarsupialAI. Use it when you need the model to write or continue text. The card lists the license as other.
iMatrix GGUFs for Qwen 1.5 32B Chat - https://huggingface.co/Qwen/Qwen1.5-32B-Chat
Downloads · 30 days
35
9% of all-time downloads
All-time downloads
375
Public
Repo size
181 GB
Likes
2
Public
Click a slice to open those files.
.gguf116 GB · 64%
From the Hugging Face model README
iMatrix GGUFs for Qwen 1.5 32B Chat - https://huggingface.co/Qwen/Qwen1.5-32B-Chat
For standard Q_K quants, see their official repo: https://huggingface.co/Qwen/Qwen1.5-32B-Chat-GGUF
iMatrix GGUFs generated with Kalomaze's semi-random groups_merged.txt
FP16 GGUF also included, as the official repo lacks it. This been split with peazip due to file size limits.
Recombine with peazip, 7zip, or simple concatenate command.