Downloads · 30 days
20
10% of all-time downloads
LFM2.5-350M-Thinking-0004-GGUF
KoarAI/LFM2.5-350M-Thinking-0004-GGUF
LFM2.5-350M-Thinking-0004-GGUF is a machine learning model from KoarAI. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Quantized GGUF binaries of KoarAI/LFM2.5-350M-Thinking-0004 for ultra-fast local inference on CPU, Vulkan, and Metal via llama.cpp.
All-time downloads
210
Public
Repo size
709 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf709 MB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Aug 30, 2026
- Updated
- Aug 31, 2026
- SHA
- fa11b483
Model card
From the Hugging Face model README
🧠 LFM2.5-350M-Thinking-0004-GGUF
Quantized GGUF binaries of KoarAI/LFM2.5-350M-Thinking-0004 for ultra-fast local inference on CPU, Vulkan, and Metal via llama.cpp.
📦 Files Available
LFM2.5-350M-Thinking-0004-f16.gguf(~709 MB) — Full Precision FP16 baseline.
🚀 Quick Start (llama.cpp)
llama-cli -m LFM2.5-350M-Thinking-0004-f16.gguf -p "<|im_start|>user\nСколько будет 17 * 19?\n<|im_end|>\n<|im_start|>assistant\n" -n 512 --temp 0.6
- License
- apache-2.0
- Languages
- ru, en
- Created
- Aug 30, 2026
- Updated
- Aug 31, 2026