Downloads · 30 days
15
13% of all-time downloads
kaitchup/LFM2.5-1.2B-Thinking-NVFP4
LFM2.5-1.2B-Thinking-NVFP4 is a machine learning model from kaitchup. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
<div align="center" <img src="https://cdn-uploads.huggingface.co/production/uploads/64b93e6bd6c468ac7536607e/mj6xac74jHGLqymiovObc.png" alt="The Kaitchup -- AI on a Budget" style="width: 100%; max-width: 100%; height:…
Downloads · 30 days
15
13% of all-time downloads
All-time downloads
119
Public
Parameters
925M
1.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors1.4 GB · 100%
How the weights are stored.
BF16436M · 47%
From the Hugging Face model README
This model has some serious quality issues. It's not broken and still chat but it significantly underperforms the original model on complicated tasks.
This is LFM2.5-1.2B-Thinking quantized with llm-compressor to NVFP4. The model is compatible with vLLM (tested: v0.14.0). Tested with an L4 (Google Colab).