Downloads · 30 days
0
TinyCeNN-LM-Distilled-v2
vtava/TinyCeNN-LM-Distilled-v2
TinyCeNN-LM-Distilled-v2 is a text generation model from vtava. Use it when you need the model to write or continue text. It is set up for transformers.
Transformer-free CeNN student distilled from arnir0/Tiny-LLM.
Access
Public
Updated Sep 10, 2026
Repo size
964 KB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json3.6 MB · 79%
At a glance
- Task
- Text Generation
- Library
- transformers
- Access
- Public
- Created
- Sep 9, 2026
- Updated
- Sep 10, 2026
- SHA
- 0cc29f2c
Try a prompt
Base models
Model card
From the Hugging Face model README
TinyCeNN-LM Distilled v2
Transformer-free CeNN student distilled from arnir0/Tiny-LLM.
Architecture
- Transformer layers remaining: 0
- CeNN recurrent steps: 7
- CeNN receptive field: 255 tokens
- Trainable CeNN parameters: 480,192
Rigorous benchmark
- Protocol: rigorous-v2
- Deterministic held-out tokens: 65,536
- Benchmark SHA256:
319c4527bb6a104bdd3772f30204fc8c32521f355f57d7c7fd387dbb058c3021 - Cumulative distillation tokens: 40,005,632
- Best student CE: 5.122586
- Teacher CE: 4.234912
- Best student PPL: 167.769
- Teacher PPL: 69.056
- Teacher-gap recovery: 84.42%
Load via tinycenn_lm.build_cenn_student().
- Task
- Text Generation
- Library
- transformers
- Created
- Sep 9, 2026
- Updated
- Sep 10, 2026