Downloads · 30 days
99
10% of all-time downloads
hrezaei/nanoGPTLookAhead
nanoGPTLookAhead is a text generation model from hrezaei. Use it when you need the model to write or continue text. The card lists the license as mit.
This model is part of the work published in the paper Interactive Text Games: Lookahead Is All You Need!
Downloads · 30 days
99
10% of all-time downloads
All-time downloads
955
Public
Parameters
160M
4.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors639 MB · 99%
From the Hugging Face model README
This model is part of the work published in the paper Interactive Text Games: Lookahead Is All You Need!
Four models are introduced in the above paper:
These models are implemented in this repository which is a customized version of nanoGPT.
The same variations are also implemented in this fork of Transformers library, on top of Google-t5/T5 implementation. These models are also trained and published as follows:
All the above models are on the scale of GPT2 (~100M parameters). The work is in progress to train them on larger scales.
This model has been pushed to the Hub using the PytorchModelHubMixin integration: