Downloads · 30 days
42
3% of all-time downloads
Youtu-LLM-2B-4bit
mlx-community/Youtu-LLM-2B-4bit
Youtu-LLM-2B-4bit is a text generation model from mlx-community. Use it when you need the model to write or continue text. It is set up for mlx-lm. The card lists the license as other.
MLX-optimized 4-bit quantized version of tencent/Youtu-LLM-2B for Apple Silicon.
All-time downloads
1.4K
Public
Parameters
2.2B
1.3 GB on disk
Likes
4
Public
Repo makeup
Click a slice to open those files.
.safetensors1.3 GB · 99%
Parameter types
How the weights are stored.
U322.2B · 100%
Try a prompt
Base models
Model card
From the Hugging Face model README
Youtu-LLM-2B 4-bit MLX
MLX-optimized 4-bit quantized version of tencent/Youtu-LLM-2B for Apple Silicon.
Quick Start
pip install mlx-lm
mlx_lm.generate \
--model mlx-community/Youtu-LLM-2B-4bit \
--prompt "Hello, what can you do?" \
--max-tokens 100
Model Details
- Base Model: tencent/Youtu-LLM-2B
- Parameters: 1.96B
- Quantization: 4-bit (4.5 bits/weight)
- Context: 128K tokens
- Architecture: Dense MLA (Multi-head Latent Attention)
- Framework: MLX (Apple Silicon optimized)
Performance (M3 Ultra)
| Quant | Prompt | Generation | Memory |
|---|---|---|---|
| bf16 | 118 tok/s | 112 tok/s | 4.7GB |
| 4-bit | 202 tok/s | 205 tok/s | 1.3GB |
Features
- Reasoning Mode: Uses
<think>tags for Chain of Thought - 128K Context: Long document understanding
- Agentic: Strong on SWE-Bench, GAIA benchmarks
- Edge-friendly: Runs on any Apple Silicon Mac
Benchmarks (vs Qwen3-4B)
| Benchmark | Youtu-LLM-2B | Qwen3-4B |
|---|---|---|
| HumanEval | 95.9% | 95.4% |
| SWE-Bench | 17.7% | 5.7% |
| GAIA | 33.9% | 25.5% |
Other Quantizations
- Full precision (4.4GB)
- 4-bit (1.2GB)
Technical Note
Converted using deepseek_v2 architecture mapping (compatible MLA implementation).
License
- Task
- Text Generation
- Library
- mlx-lm
- Type
- deepseek_v2
- License
- other
- Created
- Jan 1, 2026
- Updated
- Jan 1, 2026