Downloads · 30 days
9
14% of all-time downloads
autogen-attribute-model-mt5-base
kwskyy/autogen-attribute-model-mt5-base
autogen-attribute-model-mt5-base is a machine learning model from kwskyy. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
A finetuned model based on DKYoon/mt5-base-lm-adapt
All-time downloads
64
Public
Parameters
582M
5.8 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.2 GB · 100%
At a glance
- Library
- transformers
- Model type
- mt5
- Access
- Public
- Created
- Apr 8, 2024
- Updated
- Apr 8, 2024
- SHA
- 6486fe23
Model card
From the Hugging Face model README
A finetuned model based on DKYoon/mt5-base-lm-adapt
Original Model Card:
🤗 Language model initialized from mT5 and trained for an additional 100K steps on the Prefix LM objective using mC4 data.
Paper: [Overcoming Catastrophic Forgetting in Zero-Shot Cross-Lingual Generation](https://arxiv.org/abs/2205.12647)
Authors: Tu Vu, Aditya Barua, Brian Lester, Daniel Cer, Mohit Iyyer, Noah Constant
PyTorch port of the original Flax checkpoint at [Google/T5X repository](https://github.com/google-research/t5x).
- Library
- transformers
- Type
- mt5
- Created
- Apr 8, 2024
- Updated
- Apr 8, 2024