Downloads · 30 days
277
38% of all-time downloads
abenzerps/K2-Horizon-7B-MLX-8bit
K2-Horizon-7B-MLX-8bit is a text generation model from abenzerps. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
[](https://abenzerps.com/request-a-model/)
Downloads · 30 days
277
38% of all-time downloads
All-time downloads
727
Public
Parameters
9B
9.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors9.6 GB · 100%
How the weights are stored.
U329B · 100%
From the Hugging Face model README
MLX 8-bit conversion of IFM/K2-Horizon-7B, a 7B dense decoder-only model for reasoning, coding, long-context work, and tool use. The source checkpoint supports a native context length of 524,288 tokens (512K).

Benchmark results reported by IFM for the original IFM/K2-Horizon-7B checkpoint.
| Format | Quantization | Size |
|---|---|---|
| MLX safetensors (2 shards) | Affine 8-bit, group size 64 | 9.56 GB |
The included model.py loader preserves K2-Horizon's grouped RMSNorm. Use it with MLX-LM and --trust-remote-code. The model is text-only; no vision projector or MTP files are included.
pip install -U mlx-lm
mlx_lm.generate \
--model abenzerps/K2-Horizon-7B-MLX-8bit \
--trust-remote-code \
--prompt "Explain why reproducible builds matter." \
--max-tokens 256
2c9659a