Downloads · 30 days
8
4% of all-time downloads
4bit-SmolLM2-natural-reasoning-10k
chungimungi/4bit-SmolLM2-natural-reasoning-10k
4bit-SmolLM2-natural-reasoning-10k is a text generation model from chungimungi. Use it when you need the model to write or continue text. It is set up for peft.
fine tuned on facebook/naturalreasoning for 10K steps on one RTX4060 using 4bit quantization.
All-time downloads
193
Public
Repo size
139 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors139 MB · 97%
At a glance
- Task
- Text Generation
- Library
- peft
- Access
- Public
- Created
- Mar 24, 2025
- Updated
- Mar 25, 2025
- SHA
- 273a54c1
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
4bit-SmolLM2-natural-reasoning-10k
fine tuned on facebook/natural_reasoning for 10K steps on one RTX4060 using 4bit quantization.
Evaluated using LightEval
Framework versions
- Optimizer: AdaFactor
- Bitsandbytes
- PEFT 0.14.0
Results
| Dataset | Baseline | Ours |
|---|---|---|
| CommonsenseQA | 19.5 | 20.2 |
| PIQA | 3.1 | 12.4 |
| Winogrande | 54.6 | 54.8 |
| HellaSwag | 21.7 | 25.6 |
| MMLU | 20.2 | 19.3 |
Note: Scores Taken from here
- Task
- Text Generation
- Library
- peft
- Languages
- en
- Created
- Mar 24, 2025
- Updated
- Mar 25, 2025