Downloads · 30 days
12
3% of all-time downloads
gpt2_1558M_100B_DCLM_hf
yuchenj/gpt2_1558M_100B_DCLM_hf
gpt2_1558M_100B_DCLM_hf is a text generation model from yuchenj. Use it when you need the model to write or continue text. It is set up for transformers.
This is a GPT-2 (1558M) model trained in llm.c for 100B tokens with cosine LR on DCLM-Baseline.
All-time downloads
351
Public
Parameters
1.6B
3.1 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors3.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- gpt2
- Access
- Public
- Created
- Jul 26, 2024
- Updated
- Jul 26, 2024
- SHA
- c3acdbcd
Try a prompt
Model card
From the Hugging Face model README
This is a GPT-2 (1558M) model trained in llm.c for 100B tokens with cosine LR on DCLM-Baseline.
A lot more detailed info and observations are here: https://x.com/Yuchenj_UW/status/1813260100192334108
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- Created
- Jul 26, 2024
- Updated
- Jul 26, 2024