Downloads · 30 days
11
3% of all-time downloads
mistralrs-community/Qwen3-Coder-Next-Base-UQFF
Qwen3-Coder-Next-Base-UQFF is a machine learning model from mistralrs-community. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Generated with mistral.rs 0.9.0. Documentation: UQFF docs.
Downloads · 30 days
11
3% of all-time downloads
All-time downloads
351
Public
Repo size
562 GB
Likes
0
Public
Click a slice to open those files.
.uqff561 GB · 100%
From the Hugging Face model README
Qwen/Qwen3-Coder-Next-Base, UQFF quantizationGenerated with mistral.rs 0.9.0. Documentation: UQFF docs.
Install mistral.rs (full guide):
Linux/macOS:
curl --proto '=https' --tlsv1.2 -sSf https://raw.githubusercontent.com/EricLBuehler/mistral.rs/master/install.sh | sh
Windows (PowerShell):
irm https://raw.githubusercontent.com/EricLBuehler/mistral.rs/master/install.ps1 | iex
Note: AFQ variants are optimized for Apple Silicon / Metal.
| Quantization | Command |
|---|---|
| AFQ2 | mistralrs run -m mistralrs-community/Qwen3-Coder-Next-Base-UQFF --from-uqff afq2-0.uqff |
| AFQ3 | mistralrs run -m mistralrs-community/Qwen3-Coder-Next-Base-UQFF --from-uqff afq3-0.uqff |
| AFQ4 | mistralrs run -m mistralrs-community/Qwen3-Coder-Next-Base-UQFF --from-uqff afq4-0.uqff |
| AFQ6 | mistralrs run -m mistralrs-community/Qwen3-Coder-Next-Base-UQFF --from-uqff afq6-0.uqff |
| AFQ8 | mistralrs run -m mistralrs-community/Qwen3-Coder-Next-Base-UQFF --from-uqff afq8-0.uqff |
| Q2K | mistralrs run -m mistralrs-community/Qwen3-Coder-Next-Base-UQFF --from-uqff q2k-0.uqff |
| Q3K | mistralrs run -m mistralrs-community/Qwen3-Coder-Next-Base-UQFF --from-uqff q3k-0.uqff |
| Q4K | mistralrs run -m mistralrs-community/Qwen3-Coder-Next-Base-UQFF --from-uqff q4k-0.uqff |
| Q5K | mistralrs run -m mistralrs-community/Qwen3-Coder-Next-Base-UQFF --from-uqff q5k-0.uqff |
| Q6K | mistralrs run -m mistralrs-community/Qwen3-Coder-Next-Base-UQFF --from-uqff q6k-0.uqff |
| Q8_0 | mistralrs run -m mistralrs-community/Qwen3-Coder-Next-Base-UQFF --from-uqff q8_0-0.uqff |