Downloads · 30 days
0
pile-t5-large-t5x
EleutherAI/pile-t5-large-t5x
pile-t5-large-t5x is a machine learning model from EleutherAI. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This is the T5x version of Pile-T5 Large. You can use these checkpoints to continue pretraining or finetune using the T5x library. Scripts used to train Pile-T5 are available in the improved-t5 repository on github. T…
Access
Public
Updated Apr 17, 2024
Repo size
585 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
Other2 KB · 71%
At a glance
- Access
- Public
- Created
- Feb 28, 2024
- Updated
- Apr 17, 2024
- SHA
- 5248e28c
Datasets
Model card
From the Hugging Face model README
This is the T5x version of Pile-T5 Large. You can use these checkpoints to continue
pretraining or finetune using the T5x library.
Scripts used to train Pile-T5 are available in the improved-t5 repository
on github. To access a specific step, refer to their respective branch step_TRAININGSTEP. The main branch is left empty
For the HF version, please refer here
BibTeX
@misc{2024PileT5,
author = {Lintang Sutawika and Aran Komatsuzaki and Colin Raffel},
title = {Pile-T5},
year = {2024},
url = {https://blog.eleuther.ai/pile-t5/},
note = {Blog post},
}
- Languages
- en
- Created
- Feb 28, 2024
- Updated
- Apr 17, 2024