Downloads · 30 days
0
0% of all-time downloads
MikeRoz/Qwen3-Coder-480B-A35B-Instruct-exl3
Qwen3-Coder-480B-A35B-Instruct-exl3 is a text generation model from MikeRoz. Use it when you need the model to write or continue text. It is set up for exllamav3. The card lists the license as apache-2.0.
Exllamav3 quantization of Qwen/Qwen3-Coder-480B-A35B-Instruct
Downloads · 30 days
0
0% of all-time downloads
All-time downloads
8
Public
Repo size
305 GB
Likes
1
Public
Click a slice to open those files.
Other1.5 KB · 69%
From the Hugging Face model README
Exllamav3 quantization of Qwen/Qwen3-Coder-480B-A35B-Instruct
2.00 bpw h6 114.396 GiB
3.00 bpw h6 170.069 GiB
The 2.00bpw quant will fit in six 24 GB cards with 40k of fp16 context.