Downloads · 30 days
214
12% of all-time downloads
K2-Horizon-0.9B-GGUF
darioooooo0o/K2-Horizon-0.9B-GGUF
K2-Horizon-0.9B-GGUF is a text generation model from darioooooo0o. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
All-time downloads
1.8K
Public
Repo size
3.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf3.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Access
- Public
- Created
- Sep 3, 2026
- Updated
- Sep 3, 2026
- SHA
- 1f757049
Try a prompt
Base models
Model card
From the Hugging Face model README
K2-Horizon-0.9B GGUF quants
Requests, questions or suggestions? Message me on X: https://x.com/imdariotoo
GGUF quantizations of IFM/K2-Horizon-0.9B.
Converted with the official k2-official llama.cpp branch (MBZUAI-IFM port, commit 35999d101).
Files
| File | Quant | Size |
|---|---|---|
k2horizon-q3_k_m.gguf | Q3_K_M | ~0.5 GB |
k2horizon-q4_k_s.gguf | Q4_K_S | ~0.6 GB |
k2horizon-q4_k_m.gguf | Q4_K_M | ~0.6 GB |
k2horizon-q5_k_m.gguf | Q5_K_M | ~0.7 GB |
k2horizon-q8_0.gguf | Q8_0 | ~1.1 GB |
Requirements
Use a llama.cpp build from the k2-official branch of MBZUAI-IFM/llama.cpp (or anything that merges that port). Mainline llama.cpp does NOT support the k2-horizon architecture.
Usage
llama-cli -m k2horizon-q4_k_m.gguf -ngl 99 -c 8192
Fits entirely on any modern GPU (even iGPU); no CPU offload needed.
Notes
- Plain K-quants from BF16, no imatrix.
- All quants verified loading and generating on RTX 3060 12GB.
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Created
- Sep 3, 2026
- Updated
- Sep 3, 2026