Downloads · 30 days
52
6% of all-time downloads
gpt2_7.3B_100B_FinewebEdu_hf
yuchenj/gpt2_7.3B_100B_FinewebEdu_hf
gpt2_7.3B_100B_FinewebEdu_hf is a text generation model from yuchenj. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This is a GPT-2 (7.3B) model trained in llm.c for 100B tokens with cosine LR on Fineweb-Edu.
All-time downloads
921
Public
Parameters
7.3B
14.6 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors14.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- gpt2
- Access
- Public
- Created
- Jul 28, 2024
- Updated
- Aug 25, 2024
- SHA
- d53b07ad
Try a prompt
Datasets
Model card
From the Hugging Face model README
This is a GPT-2 (7.3B) model trained in llm.c for 100B tokens with cosine LR on Fineweb-Edu.
A lot more detailed info and observations are here: https://x.com/Yuchenj_UW/status/1817223820589375752
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- License
- mit
- Created
- Jul 28, 2024
- Updated
- Aug 25, 2024