Downloads · 30 days
1K
56% of all-time downloads
abenzerps/Nex-N2.5-mini-MLX-4bit
Nex-N2.5-mini-MLX-4bit is a text generation model from abenzerps. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
[](https://abenzerps.com/request-a-model/)
Downloads · 30 days
1K
56% of all-time downloads
All-time downloads
1.8K
Public
Parameters
34.7B
19.5 GB on disk
Likes
6
Public
Click a slice to open those files.
.safetensors19.5 GB · 100%
How the weights are stored.
U3234.7B · 100%
From the Hugging Face model README
MLX 4-bit conversion of Nex-N2.5-mini, a sparse MoE language model for local inference, coding, reasoning, and long-context work. The source checkpoint supports a native context length of 262,144 tokens (256K).

Benchmark results reported by Nex AI for the original Nex-N2.5 checkpoint and its upstream evaluation setup.
| Format | Quantization | Size |
|---|---|---|
| MLX safetensors | Affine 4-bit, group size 64 | 19.53 GB |
This release contains the text-generation weights and tokenizer. It does not include MTP weights or a vision projector.
pip install -U mlx-lm
mlx_lm.generate \
--model . \
--prompt "Explain why reproducible builds matter." \
--max-tokens 512