Downloads · 30 days
10
3% of all-time downloads
t5-small-wikitext
tomhodemon/t5-small-wikitext
t5-small-wikitext is a machine learning model from tomhodemon. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
t5-small trained on wikitext/wikitest-103-raw-v1 over 50k steps (around 2 hours of training) following T5 paper training procedure.
All-time downloads
320
Public
Repo size
484 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin242 MB · 99%
At a glance
- Library
- transformers
- Model type
- t5
- Access
- Public
- Created
- Oct 17, 2023
- Updated
- Oct 18, 2023
- SHA
- e2f37eb0
Model card
From the Hugging Face model README
t5-small-wikitext
t5-small trained on wikitext/wikitest-103-raw-v1 over 50k steps (around 2 hours of training) following T5 paper training procedure.
- batch_size: 32
- max_seq_length: 128
- optim: Adafactor
- sheduler: inverse square root (10k warm-up steps)
- Library
- transformers
- Type
- t5
- Created
- Oct 17, 2023
- Updated
- Oct 18, 2023