Downloads · 30 days
0
GPT-USENET-5
HDTenEightyP/GPT-USENET-5
GPT-USENET-5 is a text generation model from HDTenEightyP. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Access
Public
Updated Apr 29, 2026
Repo size
9.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt9.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Access
- Public
- Created
- Apr 29, 2026
- Updated
- Apr 29, 2026
- SHA
- 2a9dc209
Try a prompt
Model card
From the Hugging Face model README
GPT-Usenet-5
One of the largest LLMs possible to create in Google Colab. Trained using a corpus of 70GB of text, nearly twice that of OpenWebText. Requires 10GB of VRAM.
Technical Information
| Layers | 36 |
| Heads | 20 |
| Embeddings | 1280 |
| Context Window | 32768 tokens |
| Tokenizer | GPT-2 BPE |
| System Tokens | 💻🌀 |
| Input Tokens | 📋📄 |
| Thinking Tokens | 🧠💡 |
| Output Tokens | ✅❌ |
Place the first of each tokens before the text, and the second after the text.
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Languages
- en
- Created
- Apr 29, 2026
- Updated
- Apr 29, 2026