Downloads · 30 days
0
einygpt
clankur/einygpt
einygpt is a machine learning model from clankur. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Here's the models I've trained using the transformer I wrote in einygpt. For reference they are:
Access
Public
Updated May 16, 2024
Repo size
74.3 MB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.pth74.3 MB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- May 16, 2024
- Updated
- May 16, 2024
- SHA
- e97eb2d2
Model card
From the Hugging Face model README
einygpt
Here's the models I've trained using the transformer I wrote in einygpt. For reference they are:
- a multihead attention model replicating the model discussed in the TinyStories paper using the GPT2Tokenizer
- a multiquery attention model using the GPT2Tokenizer
- a grouped query attention model with the number of groups = 4 and using its own tokenizer
For playing with these model, you can view how they are used here
- License
- mit
- Created
- May 16, 2024
- Updated
- May 16, 2024