Downloads · 30 days
31
33% of all-time downloads
Solar-Open-100B-to-4B-test-2
llaa33219/Solar-Open-100B-to-4B-test-2
Solar-Open-100B-to-4B-test-2 is a machine learning model from llaa33219. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This model is a pruned version of upstage/Solar-Open-100B.
All-time downloads
93
Public
Parameters
4.4B
14.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8.8 GB · 100%
Parameter types
How the weights are stored.
BF164.4B · 100%
Base models
Model card
From the Hugging Face model README
Solar-Open-100B-pruned-5pct
This model is a pruned version of upstage/Solar-Open-100B.
Pruning Details
| Property | Value |
|---|---|
| Original Model | upstage/Solar-Open-100B |
| Original Parameters | 26.87B |
| Pruned Parameters | 4.40B |
| Compression Ratio | 0.1639 (6.1x smaller) |
| Strategy | Layer + Head + FFN (Recommended) |
| Importance Metric | magnitude |
| Layers Removed | 36 |
| FFN Reduction | 0.00% |
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("llaa33219/Solar-Open-100B-pruned-5pct")
tokenizer = AutoTokenizer.from_pretrained("llaa33219/Solar-Open-100B-pruned-5pct")
Notes
This model was created using structured pruning techniques including:
- Layer pruning (removing entire transformer layers)
- Attention head pruning (reducing number of attention heads)
- FFN dimension pruning (reducing intermediate layer sizes)
The pruning was based on magnitude importance scoring to preserve the most important weights.
- Type
- solar_open
- License
- apache-2.0
- Created
- Jan 8, 2026
- Updated
- Jan 8, 2026