Downloads · 30 days
27
47% of all-time downloads
hazyresearch/lolcats-llama-3.1-70b
lolcats-llama-3.1-70b is a machine learning model from hazyresearch. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This is a pure sub-quadtratic linear attention 70B parameter model, linearized from the Meta Llama 3.1 70B model starting point.
Downloads · 30 days
27
47% of all-time downloads
All-time downloads
57
Public
Repo size
435 MB
Likes
4
Public
Click a slice to open those files.
.pt234 MB · 100%
From the Hugging Face model README
This is a pure sub-quadtratic linear attention 70B parameter model, linearized from the Meta Llama 3.1 70B model starting point.
Details on this model and how to train your own are provided at: https://github.com/HazyResearch/lolcats/tree/lolcats-scaled