Downloads · 30 days
0
tinygpt-shakespeare-kvcache
narinzar/tinygpt-shakespeare-kvcache
tinygpt-shakespeare-kvcache is a text generation model from narinzar. Use it when you need the model to write or continue text. It is set up for pytorch. The card lists the license as mit.
A 3.307M-parameter char-level decoder-only transformer trained from scratch on Tiny Shakespeare. It exists to drive the benchmarks in the kv-cache-throughput-bench repo: a from-scratch KV cache, a cached-vs-uncached t…
Access
Public
Updated Jul 7, 2026
Repo size
13.2 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt13.2 MB · 100%
At a glance
- Task
- Text Generation
- Library
- pytorch
- License
- mit
- Access
- Public
- Created
- Jul 7, 2026
- Updated
- Jul 7, 2026
- SHA
- aee274d8
Try a prompt
Datasets
Model card
From the Hugging Face model README
tinygpt-shakespeare (kv-cache-throughput-bench)
A 3.307M-parameter char-level decoder-only transformer trained from scratch on Tiny Shakespeare. It exists to drive the benchmarks in the kv-cache-throughput-bench repo: a from-scratch KV cache, a cached-vs-uncached throughput sweep, and an eviction-policy study.
Architecture
- 4 layers, 4 heads, 256 embedding dim, block size 512, vocab 65 (characters)
- weight-tied token embeddings, pre-norm blocks, learned absolute positions
Training
- 2000 steps, batch 48, block 512, AdamW lr 3e-4
- 134 s on a single RTX 5090 Laptop GPU (CUDA 12.8)
- final validation loss 1.543, perplexity 4.68
Files
tinygpt.pt: state dict plus the config and char->id map
Usage
Clone the repo and load with the provided code:
from src.train import load_model
model, stoi, itos = load_model("tinygpt.pt")
Intended use and limits
Educational. A char model this small produces locally-coherent but repetitive text under greedy decoding. It is not meant for downstream language tasks.
- Task
- Text Generation
- Library
- pytorch
- License
- mit
- Created
- Jul 7, 2026
- Updated
- Jul 7, 2026