Downloads · 30 days
28
1% of all-time downloads
llmc-gpt2-774M-150B
mdouglas/llmc-gpt2-774M-150B
llmc-gpt2-774M-150B is a text generation model from mdouglas. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This is a HF/safetensors conversion of the llm.c checkpoint of a 774M parameter run on 150B tokens from FineWeb.
All-time downloads
2.1K
Public
Parameters
774M
1.8 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors1.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- gpt2
- Access
- Public
- Created
- Jun 12, 2024
- Updated
- Jun 12, 2024
- SHA
- d10fe5b1
Try a prompt
Datasets
Model card
From the Hugging Face model README
llm.c checkpoint: GPT-2 774M
This is a HF/safetensors conversion of the llm.c checkpoint of a 774M parameter run on 150B tokens from FineWeb.
Training was conducted on a single 8xA100 80GB SXM node for ~6 days.
See discussion on GitHub for more information.
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- License
- mit
- Languages
- en
- Created
- Jun 12, 2024
- Updated
- Jun 12, 2024