Downloads · 30 days
314
37% of all-time downloads
LFM2.5-350M-MLX-4bit
ipetrukha/LFM2.5-350M-MLX-4bit
LFM2.5-350M-MLX-4bit is a text generation model from ipetrukha. Use it when you need the model to write or continue text. It is set up for mlx.
Re-quantization of LiquidAI/LFM2.5-350M (revision 9e6c6ccf47cd318696e137d381a7ded8fe4df09f) with mlx-lm 0.31.3: affine, 4 bit, group size 64, no per-layer overrides — the same recipe as LiquidAI/LFM2.5-350M-MLX-4bit.
All-time downloads
849
Public
Parameters
354M
200 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors200 MB · 98%
Parameter types
How the weights are stored.
U32354M · 100%
Try a prompt
Base models
Model card
From the Hugging Face model README
LFM2.5-350M-MLX-4bit
Re-quantization of LiquidAI/LFM2.5-350M (revision 9e6c6ccf47cd318696e137d381a7ded8fe4df09f) with mlx-lm 0.31.3: affine, 4 bit, group size 64, no per-layer overrides — the same recipe as LiquidAI/LFM2.5-350M-MLX-4bit.
The one difference: this checkpoint stores quantization scales and biases in bfloat16, while the official MLX quant stores them in float32. Published so cross-engine benchmarks compare engines under one activation dtype.
Reproduce:
mlx_lm.convert --hf-path LiquidAI/LFM2.5-350M -q --q-bits 4 --q-group-size 64
- Task
- Text Generation
- Library
- mlx
- Type
- lfm2
- Languages
- en
- Created
- Sep 8, 2026
- Updated
- Sep 8, 2026