Downloads · 30 days
25
10% of all-time downloads
LFM2.5-8B-A1B-GGUF
ljupco/LFM2.5-8B-A1B-GGUF
LFM2.5-8B-A1B-GGUF is a machine learning model from ljupco. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
A GGUF conversion of LiquidAI's LFM2.5-8B-A1B (MoE, ~1B active) for llama.cpp / vllm.cpp, with a mixed quantization: the bulk of the weights are 4-bit (Q40) while the most sensitive tensors keep a higher precision. Th…
All-time downloads
253
Public
Repo size
4.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf4.8 GB · 100%
At a glance
- License
- other
- Access
- Public
- Created
- Aug 9, 2026
- Updated
- Aug 9, 2026
- SHA
- 0f542c5f
Base models
Model card
From the Hugging Face model README
LFM2.5-8B-A1B — GGUF (mixed 4-bit quant)
A GGUF conversion of LiquidAI's LFM2.5-8B-A1B (MoE, ~1B active) for llama.cpp / vllm.cpp, with a mixed quantization: the bulk of the weights are 4-bit (Q4_0) while the most sensitive tensors keep a higher precision. This is one of the four models benchmarked in the three-engine report:
Usage
llama-cli -m LFM2.5-8B-A1B-Q4_0h.gguf -p "The capital of France is" -n 64
Credits and Acknowledgements
This is a quantization of LFM2.5-8B-A1B by Liquid AI. We are deeply grateful to Liquid AI for the LFM2.5 family, its gated-delta / shortconv architecture, and for publishing the weights openly. This work builds directly on theirs, and we thank them profusely. See the report above for the full acknowledgement.
- License
- other
- Created
- Aug 9, 2026
- Updated
- Aug 9, 2026