Downloads · 30 days
0
Twitch-GPT
PsRocks/Twitch-GPT
Twitch-GPT is a machine learning model from PsRocks. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
A tiny transformer model trained on Twitch chat data, based on Andrej Karpathy's nanoGPT tutorial.
Access
Public
Updated Jun 6, 2025
Repo size
411 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.txt411 MB · 100%
At a glance
- Access
- Public
- Created
- Jun 6, 2025
- Updated
- Jun 6, 2025
- SHA
- abedb32b
Model card
From the Hugging Face model README
twitch-nanoGPT 💬🤖
A tiny transformer model trained on Twitch chat data, based on Andrej Karpathy's nanoGPT tutorial.
🚀 What This Is
This project fine-tunes a small GPT-style language model entirely on Twitch chat messages. The goal is to generate hilariously chaotic, spammy, and semi-intelligible Twitch gibberish — just like a real stream chat!
🧠 How It's Built
- Base: Andrej Karpathy's
nanoGPTminimal transformer implementation - Dataset: Twitch chat logs scraped from a stream or VOD (cleaned & formatted)
- Training: Done locally with modified hyperparameters for short-context chat
- Generation: Produces absurd chat messages
🧼 Preprocessing
Twitch chat messages were:
- Lowercased
- removed usernames
- removed @'s from chat messages
- Created
- Jun 6, 2025
- Updated
- Jun 6, 2025