Downloads · 30 days
341
36% of all-time downloads
K2-Horizon-3.7B-MLX-8bit
abenzerps/K2-Horizon-3.7B-MLX-8bit
K2-Horizon-3.7B-MLX-8bit is a text generation model from abenzerps. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
[](https://abenzerps.com/request-a-model/)
All-time downloads
953
Public
Parameters
5.1B
5.4 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors5.4 GB · 100%
Parameter types
How the weights are stored.
U325.1B · 100%
Try a prompt
Base models
Model card
From the Hugging Face model README
K2-Horizon-3.7B MLX — 8-bit
MLX 8-bit conversion of IFM/K2-Horizon-3.7B, a 3.7B dense decoder-only model for reasoning, coding, long-context work, and tool use. The source checkpoint supports a native context length of 524,288 tokens (512K).
Benchmarks
Benchmark results reported by IFM for the original IFM/K2-Horizon-3.7B checkpoint.
Release
| Format | Quantization | Size |
|---|---|---|
| MLX safetensors | Affine 8-bit, group size 64 | 5.40 GB |
The included k2_horizon_mlx.py adapter preserves K2 Horizon's grouped RMSNorm. Use it with MLX-LM and --trust-remote-code. The model is text-only; no vision projector or MTP files are included.
Usage
pip install -U mlx-lm
mlx_lm.generate \
--model . \
--trust-remote-code \
--prompt "Explain why reproducible builds matter." \
--max-tokens 512
Source
- Model: IFM/K2-Horizon-3.7B
- Source revision:
633f52a - License: Apache-2.0
- Checksums: SHA256SUMS.txt
- Task
- Text Generation
- Library
- mlx
- Type
- k2_horizon
- License
- apache-2.0
- Languages
- en
- Created
- Sep 3, 2026
- Updated
- Sep 3, 2026