Downloads · 30 days
16
30% of all-time downloads
zubenelgenubi-124m
farpluto/zubenelgenubi-124m
zubenelgenubi-124m is a text generation model from farpluto. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
A 124M-parameter GPT-2 trained from scratch on FineWeb-Edu with knowledge distillation from SmolLM-135M-Instruct.
All-time downloads
53
Public
Parameters
123M
985 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors493 MB · 50%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Model type
- gpt2
- Access
- Public
- Created
- Mar 17, 2026
- Updated
- Mar 17, 2026
- SHA
- ca404722
Try a prompt
Datasets
Model card
From the Hugging Face model README
124M GPT with Symbolic Reasoning Distillation
A 124M-parameter GPT-2 trained from scratch on FineWeb-Edu with knowledge distillation from SmolLM-135M-Instruct.
| Component | Value |
|---|---|
| Parameters | ~124M |
| Layers | 12 |
| Heads | 12 |
| Embedding dim | 768 |
| Context | 512 |
| Loss | 0.5 CE + 0.5 KL |
| Hardware | 1x A100 |
| Time | ~75 min |
| Tokens | 327,680,000 |
| Best loss | 326.0111 |
- Task
- Text Generation
- Type
- gpt2
- License
- apache-2.0
- Languages
- en
- Created
- Mar 17, 2026
- Updated
- Mar 17, 2026