Downloads · 30 days
0
0% of all-time downloads
MikeRoz/Qwen3.5-397B-A17B-exl3
Qwen3.5-397B-A17B-exl3 is a image-text-to-text model from MikeRoz. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for exllamav3. The card lists the license as apache-2.0.
exllamav3 quantizations of Qwen/Qwen3.5-397B-A17B. Quantized using commit 144d826 of the dev branch (version was bumped to v0.2.23 in the next commit).
Downloads · 30 days
0
0% of all-time downloads
All-time downloads
54
Public
Repo size
210 GB
Likes
3
Public
Click a slice to open those files.
.png33.3 KB · 93%
From the Hugging Face model README
exllamav3 quantizations of Qwen/Qwen3.5-397B-A17B. Quantized using commit 144d826 of the dev branch (version was bumped to v0.2.23 in the next commit).
2.08bpw_h6 99.272 GiB
2.00bpw_h6 96.614 GiB
Deleted the 3, 4 and 5bpw quants to save space. Another user has uploaded these here: https://huggingface.co/NeuroSenko/Qwen3.5-397B-A17B-exl3
2.00bpw
2.08bpw
