Downloads · 30 days
17
0% of all-time downloads
hgrn2_pile_100m_distill_babylm
PatrickHaller/hgrn2_pile_100m_distill_babylm
hgrn2_pile_100m_distill_babylm is a text generation model from PatrickHaller. Use it when you need the model to write or continue text. It is set up for transformers.
Our model for the 2024 BabyLM challenge 100M words track.
All-time downloads
45.6K
Public
Repo size
7.9 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- hgrn2
- Access
- Public
- Created
- Sep 11, 2024
- Updated
- Dec 17, 2024
- SHA
- 9df58a30
Try a prompt
Model card
From the Hugging Face model README
Our model for the 2024 BabyLM challenge 100M words track.
To download and use this model the fla package has to be installed:
pip install -U git+https://github.com/sustcsonglin/flash-linear-attention
- Task
- Text Generation
- Library
- transformers
- Type
- hgrn2
- Languages
- en
- Created
- Sep 11, 2024
- Updated
- Dec 17, 2024