Downloads · 30 days
208
23% of all-time downloads
tinystories-gpt-30m
Bwenge840/tinystories-gpt-30m
tinystories-gpt-30m is a text generation model from Bwenge840. Use it when you need the model to write or continue text. The card lists the license as mit.
Custom 30M parameter GPT model trained from scratch on the TinyStories dataset.
All-time downloads
905
Public
Parameters
30.1M
603 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt121 MB · 49%
At a glance
- Task
- Text Generation
- License
- mit
- Model type
- gpt2
- Access
- Public
- Created
- Aug 4, 2026
- Updated
- Aug 4, 2026
- SHA
- bd8f6dee
Try a prompt
Model card
From the Hugging Face model README
TinyStories GPT (30M Parameters)
Custom 30M parameter GPT model trained from scratch on the TinyStories dataset.
Model Details
- Architecture: Decoder-only Autoregressive Transformer (GPT)
- Parameters: 120.14M
- Context Window (
block_size): 512 subword tokens - Embedding Dimension (
n_embd): 384 - Layers / Heads: 6 layers, 6 heads
- Tokenizer: BPE (
tiktokenGPT-2 vocabulary) - Weight Tying: Enabled
- Precision: 16-bit mixed precision (
bfloat16/float16)
How to Use
from transformers import GPT2Tokenizer, pipeline
tokenizer = GPT2Tokenizer.from_pretrained("gpt2")
generator = pipeline("text-generation", model="Bwenge840/tinystories-gpt-30m", tokenizer=tokenizer)
story = generator("Once upon a time, a little girl named Jessica", max_new_tokens=150, do_sample=True, top_k=40, temperature=0.8)
print(story[0]["generated_text"])
- Task
- Text Generation
- Type
- gpt2
- License
- mit
- Languages
- en
- Created
- Aug 4, 2026
- Updated
- Aug 4, 2026