Downloads · 30 days
54
4% of all-time downloads
GPT3-dev
k050506koch/GPT3-dev
GPT3-dev is a text generation model from k050506koch. Use it when you need the model to write or continue text. The card lists the license as mit.
Welcome to the GPT3 repository! This project is an attempt to recreate the architecture and approach from the original OpenAI GPT-3 paper. The repository includes scripts for training, fine-tuning, and inference of a…
All-time downloads
1.5K
Public
Parameters
17.9M
71.5 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors71.5 MB · 94%
At a glance
- Task
- Text Generation
- License
- mit
- Model type
- gpt3dev
- Access
- Public
- Created
- Oct 22, 2024
- Updated
- Apr 17, 2026
- SHA
- 5accaa65
Try a prompt
Datasets
Model card
From the Hugging Face model README
GPT3
Welcome to the GPT3 repository! This project is an attempt to recreate the architecture and approach from the original OpenAI GPT-3 paper. The repository includes scripts for training, fine-tuning, and inference of a GPT-3-like model using PyTorch and the Hugging Face Transformers library. Here are located weights of dev checkpoints of my models. You can always download a folder, paste it's path inside inference.py and chat with them.
You can find all code on GitHub
Note: This is a very small model (17M params) so do not expect very good results. I'm getting the bigger checkpoint ready, maybe it will behave better. Benchmarks are also on their way.
Contributing
Contributions are welcome! I'm just a student who is interested in AI so my code may be incorrect or have logical issues. Please open an issue or submit a pull request for any improvements or bug fixes, I will be happy.
License
This project is licensed under the MIT License. See the LICENSE file for details. Everyone can use and modify this code at their discretion.
Acknowledgements
Thanks OpenAI, HuggingFace and Pytorch for making this project possible!
- Task
- Text Generation
- Type
- gpt3dev
- License
- mit
- Languages
- en
- Created
- Oct 22, 2024
- Updated
- Apr 17, 2026