Downloads · 30 days
21
33% of all-time downloads
FPT-Base
AmeerH/FPT-Base
FPT-Base is a text generation model from AmeerH. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This is a GPT-2 model trained for 330K steps from scratch (of 1M batch size) on FineWeb-EDU i.e around 300B Tokens.
All-time downloads
64
Public
Parameters
1.6B
3.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors3.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- gpt2
- Access
- Public
- Created
- Sep 9, 2024
- Updated
- Sep 10, 2024
- SHA
- 01ba5865
Try a prompt
Datasets
Model card
From the Hugging Face model README
This is a GPT-2 model trained for 330K steps from scratch (of 1M batch size) on FineWeb-EDU i.e around 300B Tokens.
Model Description
This is the model card of a 🤗 transformers model that has been pushed on the Hub..
Developed by: Ameer H Shared by [optional]: Ameer H Model type: GPT2 Language(s) (NLP): English License: MIT
Bias, Risks, and Limitations
Will produce blabbers and unintended slurs racial or anything. Do not blame this is just an experiment.
Forked from Andrej Karparthy's original model.
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- License
- mit
- Created
- Sep 9, 2024
- Updated
- Sep 10, 2024