Downloads · 30 days
91
11% of all-time downloads
LFM2.5-8B-A1B-Base-GGUF
johnbean393/LFM2.5-8B-A1B-Base-GGUF
LFM2.5-8B-A1B-Base-GGUF is a text generation model from johnbean393. Use it when you need the model to write or continue text. It is set up for llama.cpp. The card lists the license as other.
This repository contains an imatrix-assisted Q4KM GGUF quantization of LiquidAI/LFM2.5-8B-A1B-Base.
All-time downloads
803
Public
Repo size
5.2 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf5.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- llama.cpp
- License
- other
- Access
- Public
- Created
- May 31, 2026
- Updated
- May 31, 2026
- SHA
- 9ecf332a
Try a prompt
Base models
Model card
From the Hugging Face model README
LFM2.5-8B-A1B-Base GGUF
This repository contains an imatrix-assisted Q4_K_M GGUF quantization of
LiquidAI/LFM2.5-8B-A1B-Base.
Files
LFM2.5-8B-A1B-Base-Q4_K_M.gguf: quantized GGUF modelLFM2.5-8B-A1B-Base-imatrix.gguf: importance matrix used during quantization
Build Notes
The source safetensors file was verified against the upstream SHA-256:
9a57e48f4f70c56d4a2c7718de5cd89bee5c0402ee74b4e5da3ec519192b5c77
The conversion used llama.cpp. The local converter needed the LFM2.5 tokenizer
pre-tokenizer hash mapped to llama.cpp's existing lfm2 tokenizer identifier.
The imatrix calibration run completed, with partial coverage reported for a few MoE expert tensors in block 9. This can occur when a short calibration corpus does not route tokens through every expert equally.
Smoke Test
Before publishing, the quantized GGUF was loaded with llama.cpp in single-turn conversation mode and checked on arithmetic, JSON formatting, and a simple Python function prompt.
- Task
- Text Generation
- Library
- llama.cpp
- License
- other
- Created
- May 31, 2026
- Updated
- May 31, 2026