Downloads · 30 days
17
8% of all-time downloads
ekryski/LFM2.5-8B-A1B-4bit
LFM2.5-8B-A1B-4bit is a machine learning model from ekryski. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as apache-2.0.
4-bit affine quantization of LiquidAI/LFM2.5-8B-A1B, produced with FFAI 0.1.0's ffai convert (mlx-affine format, groupsize=64).
Downloads · 30 days
17
8% of all-time downloads
All-time downloads
211
Public
Parameters
8.5B
10.3 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors5.1 GB · 100%
How the weights are stored.
U328.2B · 97%
From the Hugging Face model README
4-bit affine quantization of LiquidAI/LFM2.5-8B-A1B, produced with FFAI 0.1.0's ffai convert (mlx-affine format, group_size=64).
ffai convert LiquidAI/LFM2.5-8B-A1B --bits 4
Model.load("LiquidAI/LFM2.5-8B-A1B") runs this checkpoint end-to-end.