Downloads · 30 days
8
14% of all-time downloads
pruned_olmo3_5120_16_32
hbfreed/pruned_olmo3_5120_16_32
pruned_olmo3_5120_16_32 is a text generation model from hbfreed. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
WARNING: This model is PRUNED ONLY, NOT retrained or distilled\! Performance will be degraded compared to the original model. This is a structural pruning checkpoint intended as a starting point for knowledge distilla…
All-time downloads
57
Public
Parameters
3.9B
7.8 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors7.8 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Model type
- olmo3
- Access
- Public
- Created
- Jan 19, 2026
- Updated
- Jan 19, 2026
- SHA
- c1913f75
Try a prompt
Base models
Model card
From the Hugging Face model README
pruned_olmo3_5120_16_32
WARNING: This model is PRUNED ONLY, NOT retrained or distilled!
Performance will be degraded compared to the original model. This is a structural pruning checkpoint intended as a starting point for knowledge distillation or fine-tuning.
Description
Structurally pruned version of allenai/OLMo-3-7B-Instruct.
Pruning Configuration
| Parameter | Original | Pruned |
|---|---|---|
| Intermediate size (MLP) | 11008 | 5120 |
| Attention heads | 32 | 16 |
| Layers | 32 | 32 |
| Hidden size | 4096 | 4096 (unchanged) |
Important Notes
- This model has NOT been retrained after pruning
- Performance will be significantly degraded compared to the original
- Intended use: Starting checkpoint for distillation/fine-tuning
- For the distillation training data, see hbfreed/dolci-distill-packed
- Task
- Text Generation
- Type
- olmo3
- License
- apache-2.0
- Created
- Jan 19, 2026
- Updated
- Jan 19, 2026