Nex-N2.5-mini-GGUF

Nex-N2.5-mini GGUF

GGUF files for Nex-N2.5-mini, a long-context agentic model for coding, tool use, computer use, and multimodal workloads. The source checkpoint supports a native context length of 262,144 tokens (256K).

Benchmarks

Benchmark results reported by Nex-AGI for the original Nex-N2.5 family. These figures are not measurements of this GGUF conversion.

GGUF files

TQ1_0 is an experimental ternary quantization. IQ1_S and IQ1_M use importance-matrix quantization.

Multimodal projector

The projector is optional for text-only use. Use it with a current llama.cpp build that supports the model's multimodal path.

Chat template

The GGUF embeds the upstream chat template. An external copy is provided as chat_template.jinja for runtimes that require a separate template file.

Usage

For text generation with llama.cpp:

llama-cli \
  -m Nex-N2.5-mini-Q4_K_M.gguf \
  -c 8192 --jinja \
  --temp 0.7 --top-p 0.95 \
  -p "Explain why reproducible builds matter."

For an OpenAI-compatible server:

llama-server \
  -m Nex-N2.5-mini-Q4_K_M.gguf \
  -c 8192 --jinja --host 0.0.0.0 --port 8080

Increase -c up to 262144 when sufficient memory is available. Tool-call behavior depends on the serving runtime and its parser integration; use the embedded template and verify tool calls in the target application.

Source and build

• Source model: nex-agi/Nex-N2.5-mini
• Source revision: 87420286149d9cce9bd46cd335ef9bda33c37c1b
• Conversion: ggml-org/llama.cpp commit f3f1a8f2760f28325a5ec20c05b171e5b7c83a29
• License: Apache-2.0
• Checksums: SHA256SUMS.txt