Downloads · 30 days
0
hyena-small-150b-tok
Zymrael/hyena-small-150b-tok
hyena-small-150b-tok is a machine learning model from Zymrael. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as bsd-3-clause.
Hyena Hierarchy: Towards Larger Convolutional Language Models: https://arxiv.org/abs/2302.10866
Access
Public
Updated Mar 6, 2023
Repo size
615 MB
Likes
17
Public
Repo makeup
Click a slice to open those files.
.ckpt615 MB · 100%
At a glance
- License
- bsd-3-clause
- Access
- Public
- Created
- Mar 6, 2023
- Updated
- Mar 6, 2023
- SHA
- d4c6ed1b
Model card
From the Hugging Face model README
Hyena Hierarchy: Towards Larger Convolutional Language Models: https://arxiv.org/abs/2302.10866
Hyena small, trained for 150 billion tokens on The Pile. See: https://github.com/HazyResearch/safari/blob/main/experiments.md for more information!
- License
- bsd-3-clause
- Created
- Mar 6, 2023
- Updated
- Mar 6, 2023