Downloads · 30 days
52
6% of all-time downloads
LFM2.5-350M-Thinking-0005-GGUF
KoarAI/LFM2.5-350M-Thinking-0005-GGUF
LFM2.5-350M-Thinking-0005-GGUF is a machine learning model from KoarAI. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
<p align="center" <img src="banner.png" alt="LFM2.5-350M-Thinking-0005 Banner" width="100%" </p
All-time downloads
928
Public
Repo size
1.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf1.1 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Aug 31, 2026
- Updated
- Aug 31, 2026
- SHA
- ecda2555
Model card
From the Hugging Face model README
<p align="center">
<img src="banner.png" alt="LFM2.5-350M-Thinking-0005 Banner" width="100%">
</p>
🧠 LFM2.5-350M-Thinking-0005-GGUF
Quantized GGUF binaries of KoarAI/LFM2.5-350M-Thinking-0005 for ultra-fast local inference on CPU, Vulkan, and Apple Metal via llama.cpp.
📦 Available Files
| File | Precision | Size | Description |
|---|---|---|---|
LFM2.5-350M-Thinking-0005-f16.gguf | FP16 | ~709 MB | Full precision golden baseline |
LFM2.5-350M-Thinking-0005-q8_0.gguf | Q8_0 | ~380 MB | High-quality quantized balance |
🚀 Quick Start (llama.cpp)
llama-cli -m LFM2.5-350M-Thinking-0005-f16.gguf -p "<|im_start|>user\nСколько букв 'р' в слове 'трапеция'? Разбери пошагово.\n<|im_end|>\n<|im_start|>assistant\n" -n 512 --temp 0.6
- License
- apache-2.0
- Languages
- ru, en
- Created
- Aug 31, 2026
- Updated
- Aug 31, 2026