Downloads · 30 days
205
100% of all-time downloads
everyones-llm-workshop
al24124/everyones-llm-workshop
everyones-llm-workshop is a text generation model from al24124. Use it when you need the model to write or continue text.
This model was trained from scratch in the EveryonesLLM GPU workshop.
All-time downloads
205
Public
Repo size
773 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt773 MB · 100%
At a glance
- Task
- Text Generation
- Access
- Public
- Created
- Sep 10, 2026
- Updated
- Sep 10, 2026
- SHA
- fa19dea8
Try a prompt
Model card
From the Hugging Face model README
EveryonesLLM workshop model
This model was trained from scratch in the EveryonesLLM GPU workshop.
Training data
- Dataset: HuggingFaceFW/fineweb-edu
- Sample: sample/10BT/000_00000.parquet
- Tokenizer: tiktoken GPT-2
Model
- Embedding dimension: 512
- Hidden dimension: 2048
- Attention heads: 8
- Transformer blocks: 4
- Context length: 512
Training
- Batch size: 64
- Steps: 2000
- Learning rate: 0.001
- BF16: True
- Seen tokens: 65536000
- Final validation loss: 4.865565538406372
Loading
This is a custom educational PyTorch model, not a Transformers AutoModel package.
Use the EveryonesLLM workshop source code to instantiate nanoGPT, then load model.pt.
Notes
The code originates from the MIT-licensed EveryonesLLM project. FineWeb-Edu is distributed under ODC-By. Check the dataset and repository terms before redistributing derived artifacts.
- Task
- Text Generation
- Languages
- en
- Created
- Sep 10, 2026
- Updated
- Sep 10, 2026