Downloads · 30 days
220
28% of all-time downloads
abenzerps/Nex-N2.5-mini-MLX-6bit
Nex-N2.5-mini-MLX-6bit is a text generation model from abenzerps. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
[](https://abenzerps.com/request-a-model/)
Downloads · 30 days
220
28% of all-time downloads
All-time downloads
772
Public
Parameters
34.7B
28.2 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors28.2 GB · 100%
How the weights are stored.
U3234.7B · 100%
From the Hugging Face model README
MLX 6-bit conversion of Nex-N2.5-mini, a sparse MoE language model for local inference, coding, reasoning, and long-context work. The source checkpoint supports a native context length of 262,144 tokens (256K).

Benchmark results reported by Nex AI for the original Nex-N2.5 checkpoint and its upstream evaluation setup.
| Format | Quantization | Size |
|---|---|---|
| MLX safetensors | Affine 6-bit, group size 64 | 28.19 GB |
This release contains the text-generation weights and tokenizer. It does not include MTP weights or a vision projector.
pip install -U mlx-lm
mlx_lm.generate \
--model . \
--prompt "Explain why reproducible builds matter." \
--max-tokens 512