Downloads · 30 days
180
44% of all-time downloads
DreamFoundries/K2-Horizon-3.7B-MLX-4bit
K2-Horizon-3.7B-MLX-4bit is a text generation model from DreamFoundries. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
[](https://mlxhub.app/open-model?repo=DreamFoundries/K2-Horizon-3.7B-MLX-4bit)
Downloads · 30 days
180
44% of all-time downloads
All-time downloads
406
Public
Parameters
5.1B
2.9 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors2.8 GB · 99%
How the weights are stored.
U325.1B · 100%
From the Hugging Face model README
MLX conversion of IFM/K2-Horizon-3.7B, created specifically for MLXHub with the DreamFoundries mlx-lm fork at 0f74c0e. Affine 4-bit quantization uses group size 64. The K2 routers (mlp.gate and, where present, self_attn.v_router) remain unquantized by the model implementation.
The original model is by Institute of Foundation Models (IFM) and is released under Apache-2.0. Comparative quality and performance benchmarks are not available for this conversion.
from mlx_lm import load, generate
model, tokenizer = load("DreamFoundries/K2-Horizon-3.7B-MLX-4bit")
response = generate(model, tokenizer, prompt="hello", verbose=True)