Downloads · 30 days
11
14% of all-time downloads
GPT-NeoX-1.3B-2GB-Eng-2
eunyounglee/GPT-NeoX-1.3B-2GB-Eng-2
GPT-NeoX-1.3B-2GB-Eng-2 is a text generation model from eunyounglee. Use it when you need the model to write or continue text. It is set up for transformers.
Pretrained GPT-NeoX model with 2.06GB English news dataset. Took about 10 hours to reach 20,000 iterations. Trained on p3.16xlarge. Different hyperparameter: gradientaccumulationstep 4
All-time downloads
77
Public
Repo size
11.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin5.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- gpt_neox
- Access
- Public
- Created
- Oct 6, 2023
- Updated
- Oct 11, 2023
- SHA
- 028ef7e2
Model card
From the Hugging Face model README
Model Card for Model ID
<!-- Provide a quick summary of what the model is/does. -->Pretrained GPT-NeoX model with 2.06GB English news dataset. Took about 10 hours to reach 20,000 iterations. Trained on p3.16xlarge.
Different hyperparameter: gradient_accumulation_step 4
Model Details
Model Description
<!-- Provide a longer summary of what this model is. -->- Developed by: Eunyoung Lee
- Model type: GPT-NeoX
- Language(s) (NLP): English
- Task
- Text Generation
- Library
- transformers
- Type
- gpt_neox
- Languages
- eng
- Created
- Oct 6, 2023
- Updated
- Oct 11, 2023