Downloads · 30 days
22
1% of all-time downloads
eswardivi/mingpt-openwebtext
mingpt-openwebtext is a text generation model from eswardivi. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Normal GPT 2 Architecture with below config trained on subset of openwebtext
Downloads · 30 days
22
1% of all-time downloads
All-time downloads
1.6K
Public
Repo size
481 MB
Likes
0
Public
Click a slice to open those files.
.bin120 MB · 97%
From the Hugging Face model README
Normal GPT 2 Architecture with below config trained on subset of openwebtext
n_ctx=256,
n_positions = 256,
n_layer = 6,
n_embd = 384,
n_head = 6,