Downloads · 30 days
299
2% of all-time downloads
Doge-20M-checkpoint
SmallDoge/Doge-20M-checkpoint
Doge-20M-checkpoint is a text generation model from SmallDoge. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
15.2K
Public
Parameters
13.1M
105 MB on disk
Likes
6
Public
Repo makeup
Click a slice to open those files.
.safetensors52.5 MB · 95%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- doge
- Access
- Public
- Created
- Jan 16, 2025
- Updated
- Jun 25, 2025
- SHA
- a51cfc68
Try a prompt
Datasets
Model card
From the Hugging Face model README
Doge 20M checkpoint
Doge uses wsd_scheduler as the training scheduler, which divides the learning rate into three stages: warmup, stable, and decay. It allows us to continue training on any new dataset from any checkpoint in the stable stage without spikes of the training.
Here are the initial learning rates required to continue training at each checkpoint:
- Task
- Text Generation
- Library
- transformers
- Type
- doge
- License
- apache-2.0
- Languages
- en
- Created
- Jan 16, 2025
- Updated
- Jun 25, 2025