Downloads · 30 days
108
65% of all-time downloads
gemma3-270m-tinystories
chinmaydk99/gemma3-270m-tinystories
gemma3-270m-tinystories is a text generation model from chinmaydk99. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
This is a custom implementation of Gemma-3 270M parameter model fine-tuned on the TinyStories dataset.
All-time downloads
167
Public
Repo size
659 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin330 MB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Model type
- gemma3
- Access
- Public
- Created
- Sep 1, 2025
- Updated
- Sep 1, 2025
- SHA
- 44b75a69
Try a prompt
Datasets
Model card
From the Hugging Face model README
Gemma-3 270M Fine-tuned on TinyStories
This is a custom implementation of Gemma-3 270M parameter model fine-tuned on the TinyStories dataset.
Model Details
- Architecture: Custom Gemma-3 with sliding window attention
- Parameters: ~270M
- Training Dataset: TinyStories
- Context Length: 32,768 tokens
- Sliding Window: 512 tokens
Usage
# Note: This model requires the custom Gemma3Model class from the training notebook
# You'll need to copy the model definition to use this model
Training Details
- Trained for 150,000 steps
- Final training loss: ~2.55
- Final validation loss: ~2.56
- Task
- Text Generation
- Type
- gemma3
- License
- apache-2.0
- Languages
- en
- Created
- Sep 1, 2025
- Updated
- Sep 1, 2025