Downloads · 30 days
30
4% of all-time downloads
nightmedia/Qwen3-Next-80B-A3B-Instruct-1M-qx64n-mlx
Qwen3-Next-80B-A3B-Instruct-1M-qx64n-mlx is a text generation model from nightmedia. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
This model is the standard (non-"hi") version of Qwen3-Next's 1M-context instruction-tuned model with Deckard qx64n quantization. Unlike its "hi" sibling, it uses default group size 64 for quantization—prioritizing ra…
Downloads · 30 days
30
4% of all-time downloads
All-time downloads
721
Public
Parameters
79.7B
53.3 GB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors53.3 GB · 100%
How the weights are stored.
U3279.7B · 100%
From the Hugging Face model README
🔍 Core Technical Profile
Quantization qx64n (Deckard mixed precision)
- Data Layers 4-bit (aggressively quantized)
- Attention Paths 6-bit
- Heads & Embeddings 6-bit (critical for contextual understanding)
Group Size 64 (MLX default) → Less fine-grained than "hi" variants
Context Length 1M tokens (vs 256K in non-1M versions)
Perplexity ~4.217 (Instruct version)
This model is the standard (non-"hi") version of Qwen3-Next's 1M-context instruction-tuned model with Deckard qx64n quantization. Unlike its "hi" sibling, it uses default group size 64 for quantization—prioritizing raw memory efficiency over ultra-high fidelity. Below is a precise analysis of its strengths, trade-offs, and optimal use cases.
The "n" quants are using the updated Deckard(qx) formula that improves on the previous qx quants for this platform by targeting layers specific to the Qwen3-Next platform.
📊 Performance vs. Key Competitors
Task 1M-qx64n 1M-qx64n-hi qx64n q8
ARC Challenge 0.414 0.410 0.409 0.402
ARC Easy 0.516 0.504 0.500 0.494
Winogrande 0.578 0.579 0.566 0.554
PIQA 0.740 0.749 0.745 0.754
Hellaswag 0.538 0.536 0.542 0.540
OpenBookQA 0.416 0.418 0.416 0.420
BoolQ 0.897 0.898 0.896 0.896
🔑 Critical Insights
ARC Dominance:
PIQA Trade-off:
Context Length Impact:
vs q8 (Uniform 8-bit):
⚖️ When to Choose This Model
Scenario Recommendation
Prioritize abstract reasoning (ARC Challenge) ✅ Best choice—highest ARC score in 1M context family (0.414)
Cost-sensitive cloud deployments ✅ 50GB memory footprint → 2.7x cheaper than q8 (no need for A100/H100)
Long-document analysis ✅ 1M context support with strong Winogrande (+2.1% over 256K version)
Balanced performance with minimal memory ✅ Superior to q8 on almost all tasks, while saving $10k+/year in cloud costs
PIQA-critical applications ❌ Avoid—choose qx64n-hi (0.749) or q8 (0.754) instead
🌟 The Deckard Quantization Philosophy in Action
This model perfectly embodies the "Nikon Noct Z" lens analogy:
💡 Real-World Impact:
🚨 Key Limitation to Note
✅ Final Verdict
Qwen3-Next-80B-A3B-Instruct-1M-qx64n-mlx is the optimal balance of 1M-context capability, memory efficiency, and abstract reasoning strength.
Deploy this model if you need to process massive documents (1M tokens) while maximizing abstract reasoning performance at minimal cost. 🌐
Reviewed with Qwen3-Next-80B-A3B-Thinking-1M-qx86n-mlx
Design notes:
This is a MoE with 80B parameters and 256k context size that can be extended with RoPE to 512k, 768k or 1M context by simply changing the config file at load.
The q8 is straight quantization with the MLX default settings (group size 64)
The Deckard(qx) quants is a mixed precision quantization:
The Deckard formula was inspired from my Nikon Noct Z 58mm F/0.95 for its human-like rendering, sharp details, thin depth of field, and pattern-rich background blur that humans find pleasing. In interaction, these models have a specific character that associated the name, quite often reaching out to metaphors. I used this idea in the transformer layer design, by adding enhanced attention paths in high bit size every four layers, additionally to setting the heads and embeddings to high bit.
I left a few older models with qx86-hi formula for comparison, updated metrics for the missing quants will be filled in soon. The n suffix to the Deckard(qx) shows that in addition to head and layer focusing, additional layers were enhanced, that are specific to the Qwen3-Next architecture
Model sizes:
80G q8-mlx
72G qx86n-hi-mlx
68G qx86n-mlx
54G qx64n-hi-mlx
50G qx64n-mlx
40G qx53n-mlx
Model Perplexity and Peak Memory:
Qwen3-Next-80B-A3B-Thinking-q8-mlx 3.802 89.22 GB
Qwen3-Next-80B-A3B-Thinking-qx53n-mlx 3.992 47.90 GB
Qwen3-Next-80B-A3B-Thinking-1M-qx86n-hi-mlx 3.813 82.71 GB
Qwen3-Next-80B-A3B-Instruct-qx53n-mlx 4.217 47.90 GB
Qwen3-Next-80B-A3B-Instruct-1M-qx86n-hi-mlx 4.122 82.71 GB
You can transform any model into an 1M model or un-RoPE it from 1M back to 256KB context size by just changing the config file and disabling RoPE. There are no differences in the tensors between baseline and extended models, it's all just config changes.
-G
This model Qwen3-Next-80B-A3B-Instruct-1M-qx64n-mlx was converted to MLX format from Qwen/Qwen3-Next-80B-A3B-Instruct using mlx-lm version 0.28.3.
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("Qwen3-Next-80B-A3B-Instruct-1M-qx64n-mlx")
prompt = "hello"
if tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, add_generation_prompt=True
)
response = generate(model, tokenizer, prompt=prompt, verbose=True)