Downloads · 30 days
14
45% of all-time downloads
LFM2.5-VL-3B-ffn6144-int4
konic-labs/LFM2.5-VL-3B-ffn6144-int4
LFM2.5-VL-3B-ffn6144-int4 is a machine learning model from konic-labs. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
The smallest checkpoint in the series: FFN pruned 10752 → 6144 (−43%) + distillation recovery, then native INT4/INT8 (compressed-tensors).
All-time downloads
31
Public
Parameters
2.8B
2.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.4 GB · 99%
Parameter types
How the weights are stored.
I322.1B · 77%
Model card
From the Hugging Face model README
LFM2.5-VL-3B-ffn6144-int4
The smallest checkpoint in the series: FFN pruned 10752 → 6144 (−43%) + distillation recovery, then native INT4/INT8 (compressed-tensors).
Caveat: tool-calling emits the correct tool and arguments, but the closing
<|tool_call_end|> tag may be missing — not recommended for tool-calling
runtimes. Vision/text generation is validated.
| Size | vs original | |
|---|---|---|
| Original BF16 | 6.25 GB | — |
| This checkpoint (INT4/INT8) | 2.40 GB | −62% |
Quality vs base (quick suite): text/mm PPL ratio 0.91/0.84 (PASS), kld 0.35/0.37, generation chrF 0.44/0.46, integrity index 40.5 (record-only).
Serve with vLLM
from vllm import LLM
llm = LLM(model="konic-labs/LFM2.5-VL-3B-ffn6144-int4",
quantization="compressed-tensors")
Derivative of LiquidAI/LFM2.5-VL-3B (LFM Open License v1.0). Pipeline:
https://github.com/konic-labs/lfm25-vl-3b-lab · Collection:
LFM2.5 3B Vision - Optimized.
- Type
- lfm2_vl
- License
- other
- Created
- Aug 13, 2026
- Updated
- Aug 13, 2026