Downloads · 30 days
35
11% of all-time downloads
npario/LFM2.5-2.6B-GGUF
LFM2.5-2.6B-GGUF is a text generation model from npario. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as other.
<div align="center" <img src="https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/2b08LKpev0DNEk6DlnWkY.png" alt="Liquid AI" style="width: 100%; max-width: 100%; height: auto; display: inlin…
Downloads · 30 days
35
11% of all-time downloads
All-time downloads
311
Public
Repo size
22.7 GB
Likes
0
Public
Click a slice to open those files.
.gguf22.7 GB · 100%
From the Hugging Face model README
LFM2.5 is a new family of hybrid models designed for on-device deployment. It builds on the LFM2 architecture with extended pre-training and reinforcement learning.
Find more details in the original model card: https://huggingface.co/LiquidAI/LFM2.5-2.6B
Example usage with llama.cpp:
llama-cli -hf LiquidAI/LFM2.5-2.6B-GGUF --conversation \
--temp 0.1 --top-k 50 --repeat-penalty 1.1
The Quantization-Aware Distillation (QAD) checkpoint is available as
LFM2.5-2.6B-QAD-Q4_0.gguf.
This is distinct from the post-training-quantized LFM2.5-2.6B-Q4_0.gguf;
both use the GGUF Q4_0 format.