Downloads · 30 days
6
38% of all-time downloads
SmolLM2_135M_reverse_engineered
niishantth/SmolLM2_135M_reverse_engineered
SmolLM2_135M_reverse_engineered is a machine learning model from niishantth. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This project is a from-scratch PyTorch implementation of SmolLM2-135M.
All-time downloads
16
Public
Parameters
163M
326 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors326 MB · 99%
At a glance
- Model type
- llama
- Access
- Public
- Created
- Jan 4, 2026
- Updated
- Jan 4, 2026
- SHA
- 0f1c30dd
Spaces
Model card
From the Hugging Face model README
SmolLM2-135M – From Scratch
This project is a from-scratch PyTorch implementation of SmolLM2-135M.
What this demonstrates
- Architecture reverse-engineered (RMSNorm, RoPE, GQA)
- Numerical match with Hugging Face reference model
- Fine-tuned on TinyStories-Instruct
- FP16 safetensors export
- Deployed via Hugging Face Spaces
Usage
Enter a prompt and generate text using greedy decoding.
Notes
This is an educational + research project demonstrating full LLM reproduction.
- Type
- llama
- Created
- Jan 4, 2026
- Updated
- Jan 4, 2026