Downloads · 30 days
28
10% of all-time downloads
LFM2-8B-A1B-Instruct-QwenDistill
Tivaphraen/LFM2-8B-A1B-Instruct-QwenDistill
LFM2-8B-A1B-Instruct-QwenDistill is a text generation model from Tivaphraen. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
All-time downloads
267
Public
Repo size
11 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf11 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Access
- Public
- Created
- May 30, 2026
- Updated
- Jul 7, 2026
- SHA
- 7814113c
Try a prompt
Base models
Model card
From the Hugging Face model README
LFM2-8B-A1B-Instruct-QwenDistill - GGUF
This repository contains GGUF format quantizations of the model DavidAU/LFM2-8B-A1B-Instruct-Quantum-IQ1C-Qwen3.6-35B-A3B-DISTILL.
Quantization was performed locally using llama.cpp (build b9433).
Files Available
- LFM2-8B-A1B-Instruct-QwenDistill-Q5_K_M.gguf (~5.64 GB) : Recommended balance. High accuracy, very low performance loss.
- LFM2-8B-A1B-Instruct-QwenDistill-Q4_K_M.gguf (~4.81 GB) : Standard quantization. Fastest inference speed, smaller memory footprint.
Performance Test (Local CPU Inference)
The following benchmarks were obtained running the model locally on a standard laptop configuration, without GPU acceleration.
Hardware Specifications:
- CPU: Intel Core i5 (11th Gen)
- RAM: 32 GB
- OS: Windows
Inference Results (llama-cli.exe):
-
LFM2-8B-A1B-Instruct-QwenDistill-Q4_K_M.gguf :
- Prompt Evaluation: ~41 t/s
- Token Generation: ~24 t/s
-
LFM2-8B-A1B-Instruct-QwenDistill-Q5_K_M.gguf :
- Prompt Evaluation: ~28 t/s
- Token Generation: ~20 t/s
- Task
- Text Generation
- License
- apache-2.0
- Languages
- en, fr
- Created
- May 30, 2026
- Updated
- Jul 7, 2026