Downloads · 30 days
10
1% of all-time downloads
hit5-base
hiiamsid/hit5-base
hit5-base is a machine learning model from hiiamsid. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.
This is a smaller version of the google/mt5-base model with only hindi embeddings left. The original model has 582M parameters, with 237M of them being input and output embeddings. After shrinking the sentencepiece vo…
All-time downloads
1.1K
Public
Repo size
1.9 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin950 MB · 100%
At a glance
- Library
- transformers
- License
- mit
- Model type
- t5
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Dec 15, 2021
- SHA
- f2d4074b
Model card
From the Hugging Face model README
This is a smaller version of the google/mt5-base model with only hindi embeddings left.
- The original model has 582M parameters, with 237M of them being input and output embeddings.
- After shrinking the
sentencepiecevocabulary from 250K to 25K (top 25K Hindi tokens) the number of model parameters reduced to 237M parameters, and model size reduced from 2.2GB to 0.9GB - 42% of the original one.
Citing & Authors
- Model : google/mt5-base
- Reference: cointegrated/rut5-base
- Library
- transformers
- Type
- t5
- License
- mit
- Languages
- hi
- Created
- Mar 2, 2022
- Updated
- Dec 15, 2021