Downloads · 30 days
29
36% of all-time downloads
Pruned-SmolLM2-1.4B
aloobun/Pruned-SmolLM2-1.4B
Pruned-SmolLM2-1.4B is a text generation model from aloobun. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Pruned SmolLM2-1.7B model - total parameters 1.47B.
All-time downloads
80
Public
Parameters
1.5B
2.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Nov 26, 2024
- Updated
- Nov 27, 2024
- SHA
- 95481529
Try a prompt
Model card
From the Hugging Face model README
Pruned SmolLM2-1.7B model - total parameters 1.47B.
Intermediate step, requires further training - try it yourself.
Eval results using SmolLM evaluation scripts (LightEval):
| Task | Version | Metric | Value | Stderr | |
|---|---|---|---|---|---|
| all | acc_norm | 0.4555 | ± | 0.0114 | |
| qem | 0.0431 | ± | 0.0022 | ||
| custom:arc:_average:0 | acc_norm | 0.5021 | ± | 0.0120 | |
| custom:arc:challenge:0 | 0 | acc_norm | 0.3686 | ± | 0.0141 |
| custom:arc:easy:0 | 0 | acc_norm | 0.6355 | ± | 0.0099 |
| custom:commonsense_qa:0 | 0 | acc_norm | 0.3333 | ± | 0.0135 |
| custom:gsm8k:5 | 0 | qem | 0.0076 | ± | 0.0024 |
| custom:hellaswag:0 | 0 | acc_norm | 0.5568 | ± | 0.0050 |
| custom:mmlu_pro:0 | 0 | acc_norm | 0.1287 | ± | 0.0031 |
| custom:openbook_qa:0 | 0 | acc_norm | 0.3660 | ± | 0.0216 |
| custom:piqa:0 | 0 | acc_norm | 0.7187 | ± | 0.0105 |
| custom:trivia_qa:0 | 0 | qem | 0.0787 | ± | 0.0020 |
| custom:winogrande:0 | 0 | acc_norm | 0.5367 | ± | 0.0140 |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Created
- Nov 26, 2024
- Updated
- Nov 27, 2024