Downloads · 30 days
32
1% of all-time downloads
rudygpt
rudyon/rudygpt
rudygpt is a text generation model from rudyon. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
A 124M parameter causal language model trained from scratch using rudyon/pipeline on the HuggingFaceFW/fineweb-edu dataset.
All-time downloads
5.5K
Public
Parameters
137M
3.2 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.pt1.5 GB · 58%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- rudygpt
- Access
- Public
- Created
- Mar 12, 2026
- Updated
- Mar 19, 2026
- SHA
- dd42cab1
Try a prompt
Datasets
Model card
From the Hugging Face model README
rudygpt
A 124M parameter causal language model trained from scratch using rudyon/pipeline on the HuggingFaceFW/fineweb-edu dataset.
Training was done on a vast.ai instance with 2x 4090S Ti. Training cost was about ~$10.
usage
import torch
from transformers import AutoTokenizer
# download model.py and pytorch_model.bin manually or via hf_hub_download
from model import GPT, GPTConfig
device = 'cuda' if torch.cuda.is_available() else 'cpu'
tokenizer = AutoTokenizer.from_pretrained("rudyon/rudygpt")
model = GPT(GPTConfig(depth=12, vocab_size=50304))
state_dict = torch.load("pytorch_model.bin", map_location=device)
model.load_state_dict(state_dict)
model.eval()
print(model.generate("Hello!"))
- Task
- Text Generation
- Library
- transformers
- Type
- rudygpt
- License
- mit
- Languages
- en
- Created
- Mar 12, 2026
- Updated
- Mar 19, 2026