Downloads · 30 days
7
13% of all-time downloads
pruned_olmo3_5120_32_30
hbfreed/pruned_olmo3_5120_32_30
pruned_olmo3_5120_32_30 is a text generation model from hbfreed. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
WARNING: This model is PRUNED ONLY, NOT retrained or distilled\! Performance will be degraded compared to the original model. This is a structural pruning checkpoint intended as a starting point for knowledge distilla…
All-time downloads
52
Public
Parameters
4.7B
9.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors9.4 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Model type
- olmo3
- Access
- Public
- Created
- Jan 19, 2026
- Updated
- Jan 19, 2026
- SHA
- 119e9c2d
Try a prompt
Base models
Model card
From the Hugging Face model README
pruned_olmo3_5120_32_30
WARNING: This model is PRUNED ONLY, NOT retrained or distilled!
Performance will be degraded compared to the original model. This is a structural pruning checkpoint intended as a starting point for knowledge distillation or fine-tuning.
Description
Structurally pruned version of allenai/OLMo-3-7B-Instruct.
Pruning Configuration
| Parameter | Original | Pruned |
|---|---|---|
| Intermediate size (MLP) | 11008 | 5120 |
| Attention heads | 32 | 32 |
| Layers | 32 | 30 |
| Hidden size | 4096 | 4096 (unchanged) |
Important Notes
- This model has NOT been retrained after pruning
- Performance will be significantly degraded compared to the original
- Intended use: Starting checkpoint for distillation/fine-tuning
- For the distillation training data, see hbfreed/dolci-distill-packed
- Task
- Text Generation
- Type
- olmo3
- License
- apache-2.0
- Created
- Jan 19, 2026
- Updated
- Jan 19, 2026