Downloads · 30 days
220
47% of all-time downloads
K2-Horizon-7B-MLX-4bit
DreamFoundries/K2-Horizon-7B-MLX-4bit
K2-Horizon-7B-MLX-4bit is a text generation model from DreamFoundries. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
[](https://mlxhub.app/open-model?repo=DreamFoundries/K2-Horizon-7B-MLX-4bit)
All-time downloads
467
Public
Parameters
9B
5.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5.1 GB · 100%
Parameter types
How the weights are stored.
U329B · 100%
Try a prompt
Base models
Model card
From the Hugging Face model README
K2 Horizon 7B MLX 4-bit
MLX conversion of IFM/K2-Horizon-7B, created specifically for MLXHub with the DreamFoundries mlx-lm fork at 0f74c0e. Affine 4-bit quantization uses group size 64. The K2 routers (mlp.gate and, where present, self_attn.v_router) remain unquantized by the model implementation.
The original model is by Institute of Foundation Models (IFM) and is released under Apache-2.0. Comparative quality and performance benchmarks are not available for this conversion.
Use with MLX
from mlx_lm import load, generate
model, tokenizer = load("DreamFoundries/K2-Horizon-7B-MLX-4bit")
response = generate(model, tokenizer, prompt="hello", verbose=True)
- Task
- Text Generation
- Library
- mlx
- Type
- k2_horizon
- License
- apache-2.0
- Languages
- en
- Created
- Sep 4, 2026
- Updated
- Sep 4, 2026