Downloads · 30 days
102
9% of all-time downloads
Nex-N2-Pro-GGUF
tarruda/Nex-N2-Pro-GGUF
Nex-N2-Pro-GGUF is a image-text-to-text model from tarruda. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
My custom IQ2XXS/IQ3XXS GGUF quantization for nex-agi/Nex-N2-Pro
All-time downloads
1.2K
Public
Repo size
128 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf128 GB · 100%
At a glance
- Task
- Image-Text-to-Text
- License
- apache-2.0
- Access
- Public
- Created
- Jul 10, 2026
- Updated
- Jul 14, 2026
- SHA
- affd92de
Try a prompt
Base models
Model card
From the Hugging Face model README
Nex N2 Pro GGUF
My custom IQ2_XXS/IQ3_XXS GGUF quantization for nex-agi/Nex-N2-Pro
The chat template adds preserve_thinking option to improve experience with
coding agents on platforms with slow prompt processing.
Quant Recipes
| Recipe | Quant Size | Default type | Tensor-specific overrides |
|---|---|---|---|
IQ3_XXS | 119093.00 MiB (2.52 BPW) | Q6_K | *.attn*=q8_0, ffn_down_exps=iq3_xxs, ffn_gate_exps=iq2_xxs, ffn_up_exps=iq2_xxs |
Usage
Here's an example script:
#!/bin/sh -e
model=./IQ3_XXS/Nex-N2-Pro-IQ3_XXS-00001-of-00004.gguf
mmproj=./IQ3_XXS/Nex-N2-Pro-mmproj-Q8_0.gguf
parallel=1
ctx=262144
reasoning_budget_message=". Need answer.
Let's draft final."
ctx_size=$((ctx * parallel))
llama-server --no-warmup --no-mmap \
--model $model --mmproj $mmproj \
-ctk q8_0 -ctv q8_0 \
--ctx-size $ctx_size -np $parallel \
--temp 0.7 --top-p 0.95 --top-k 40 \
--repeat-penalty 1.0 --presence-penalty 0.0 \
-cram 0 \
--reasoning-budget-message "$reasoning_budget_message" \
--reasoning-preserve \
--ctx-checkpoints 2 --checkpoint-min-step 1024 \
--host 0.0.0.0
- Task
- Image-Text-to-Text
- License
- apache-2.0
- Created
- Jul 10, 2026
- Updated
- Jul 14, 2026