Downloads · 30 days
18
10% of all-time downloads
ljupco/LFM2.5-1.2B-Thinking-GGUF
LFM2.5-1.2B-Thinking-GGUF is a machine learning model from ljupco. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
A GGUF conversion of LiquidAI's LFM2.5-1.2B-Thinking for llama.cpp / vllm.cpp, with a mixed quantization: the bulk of the weights are 4-bit (Q40) while the most sensitive tensors keep a higher precision. This variant…
Downloads · 30 days
18
10% of all-time downloads
All-time downloads
178
Public
Repo size
661 MB
Likes
0
Public
Click a slice to open those files.
.gguf661 MB · 100%
From the Hugging Face model README
A GGUF conversion of LiquidAI's LFM2.5-1.2B-Thinking for llama.cpp / vllm.cpp, with a mixed quantization: the bulk of the weights are 4-bit (Q4_0) while the most sensitive tensors keep a higher precision. This variant is one of the four models benchmarked in the three-engine report:
llama-cli -m LFM2.5-1.2B-Thinking-Q4_0h.gguf -p "The capital of France is" -n 64
This is a quantization of LFM2.5-1.2B-Thinking by Liquid AI. We are deeply grateful to Liquid AI for the LFM2.5 family, its gated-delta / shortconv architecture, and for publishing the weights openly. This work builds directly on theirs, and we thank them profusely. See the report above for the full acknowledgement.