Downloads · 30 days
9
10% of all-time downloads
Minthy/Qwen3-235B-A22B-Instruct-2507-exl3-5.0bpw
Qwen3-235B-A22B-Instruct-2507-exl3-5.0bpw is a text generation model from Minthy. Use it when you need the model to write or continue text. It is set up for exllamav3. The card lists the license as apache-2.0.
Exl3 5.0bpw h6 quantization of Qwen/Qwen3-235B-A22B-Instruct-2507 using 69750c8 commit of Exllamav3
Downloads · 30 days
9
10% of all-time downloads
All-time downloads
92
Public
Parameters
74.2B
148 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors148 GB · 100%
How the weights are stored.
I1673.3B · 99%
From the Hugging Face model README
Exl3 5.0bpw h6 quantization of Qwen/Qwen3-235B-A22B-Instruct-2507 using 69750c8 commit of Exllamav3
148.4gb, requires ~160gb with 64k unquantized context.