Downloads · 30 days
79
15% of all-time downloads
hazyresearch/lolcats-llama-3.1-8b-distill
lolcats-llama-3.1-8b-distill is a text generation model from hazyresearch. Use it when you need the model to write or continue text.
This is a pure sub-quadtratic linear attention 8B parameter model, linearized from the Meta Llama 3.1 8B model.
Downloads · 30 days
79
15% of all-time downloads
All-time downloads
530
Public
Repo size
33.6 MB
Likes
14
Public
Click a slice to open those files.
.pt33.6 MB · 100%
From the Hugging Face model README
This is a pure sub-quadtratic linear attention 8B parameter model, linearized from the Meta Llama 3.1 8B model.
Details on this model and how to train your own are provided at: https://github.com/HazyResearch/lolcats/tree/lolcats-scaled
Here is a quick GitHub GIST that will help you run inference on the model checkpoints.
See the paper page: https://huggingface.co/papers/2410.10254