Downloads · 30 days
6
16% of all-time downloads
Solar-Open-100B-pruned-5pct-test2
llaa33219/Solar-Open-100B-pruned-5pct-test2
Solar-Open-100B-pruned-5pct-test2 is a machine learning model from llaa33219. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This model is a pruned version of upstage/Solar-Open-100B.
All-time downloads
37
Public
Parameters
36.3B
72.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors72.7 GB · 100%
Parameter types
How the weights are stored.
BF1636.3B · 100%
Base models
Model card
From the Hugging Face model README
Solar-Open-100B-pruned-5pct
This model is a pruned version of upstage/Solar-Open-100B.
Pruning Details
| Property | Value |
|---|---|
| Original Model | upstage/Solar-Open-100B |
| Original Parameters | 9.46B |
| Pruned Parameters | 3.09B |
| Compression Ratio | 0.3261 (3.1x smaller) |
| Strategy | Layer + Head + FFN (Recommended) |
| Importance Metric | magnitude |
| Layers Removed | 31 |
| FFN Reduction | 60.00% |
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("llaa33219/Solar-Open-100B-pruned-5pct")
tokenizer = AutoTokenizer.from_pretrained("llaa33219/Solar-Open-100B-pruned-5pct")
Notes
This model was created using structured pruning techniques including:
- Layer pruning (removing entire transformer layers)
- Attention head pruning (reducing number of attention heads)
- FFN dimension pruning (reducing intermediate layer sizes)
The pruning was based on magnitude importance scoring to preserve the most important weights.
- Type
- solar_open
- License
- apache-2.0
- Created
- Jan 6, 2026
- Updated
- Jan 6, 2026