Downloads · 30 days
5
12% of all-time downloads
prasannaJagadesh/my-mini-stories
my-mini-stories is a machine learning model from prasannaJagadesh. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
A simple transformer decoder-only model trained from scratch on the TinyStories dataset.
Downloads · 30 days
5
12% of all-time downloads
All-time downloads
41
Public
Parameters
64.7M
259 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors259 MB · 99%
From the Hugging Face model README
A simple transformer decoder-only model trained from scratch on the TinyStories dataset.
| Parameter | Value |
|---|---|
| Layers | 12 |
| Hidden Size | 384 |
| Attention Heads | 6 |
| Attention Type | MHA |
| FFN Type | ReLU |
| Vocab Size | 50,257 |
| Max Sequence Length | 256 |
this is my first model which I trained from scratch kind of proud of myself for this i know this isn't huge but honest work, it's going to defnitely improve from here
Full Logs: here is the full joruney of the model logs
View Evaluation Logs
Analysis: here you can find deeper about the model perfomance
[Read Performance Details](https://github.com/Prasannajaga/transformers-playground/blob/main/src/models/tiny-sto