Downloads · 30 days
37
1% of all-time downloads
gpt2-774M-fineweb-150B
rhysjones/gpt2-774M-fineweb-150B
gpt2-774M-fineweb-150B is a text generation model from rhysjones. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This is karpathy's model from the llm.c project converted to HF format to investigate bfloat16 performance.
All-time downloads
5.5K
Public
Parameters
774M
1.5 GB on disk
Likes
6
Public
Repo makeup
Click a slice to open those files.
.safetensors1.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- gpt2
- Access
- Public
- Created
- Jun 16, 2024
- Updated
- Jun 19, 2024
- SHA
- 76942213
Try a prompt
Datasets
Model card
From the Hugging Face model README
This is karpathy's model from the llm.c project converted to HF format to investigate bfloat16 performance.
The training run was 150B tokens, 1.5 epochs over the 100B FineWeb sample dataset.
There's active work underway at https://github.com/karpathy/llm.c so I'd suggest following the developments there!
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- License
- mit
- Created
- Jun 16, 2024
- Updated
- Jun 19, 2024