Downloads · 30 days
271
0% of all-time downloads
mt5-zh-ja-en-trimmed
K024/mt5-zh-ja-en-trimmed
mt5-zh-ja-en-trimmed is a translation model from K024. Use it when you need text moved from one language to another. It is set up for transformers. The card lists the license as cc-by-nc-sa-4.0.
All-time downloads
68.7K
Public
Repo size
2.6 GB
Likes
57
Public
Repo makeup
Click a slice to open those files.
.bin1.3 GB · 100%
At a glance
- Task
- Translation
- Library
- transformers
- License
- cc-by-nc-sa-4.0
- Model type
- mt5
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Mar 24, 2022
- SHA
- 6da33524
Try a prompt
Model card
From the Hugging Face model README
This model is finetuned from mt5-base.
The model vocabulary is trimmed to ~1/3 by selecting top 85000 tokens in the training data. The code to trim the vocabulary can be found here.
Usage:
from transformers import (
T5Tokenizer,
MT5ForConditionalGeneration,
Text2TextGenerationPipeline,
)
path = "K024/mt5-zh-ja-en-trimmed"
pipe = Text2TextGenerationPipeline(
model=MT5ForConditionalGeneration.from_pretrained(path),
tokenizer=T5Tokenizer.from_pretrained(path),
)
sentence = "ja2zh: 吾輩は猫である。名前はまだ無い。"
res = pipe(sentence, max_length=100, num_beams=4)
res[0]['generated_text']
Training data:
wikimedia-en-ja
wikimedia-en-zh
wikimedia-ja-zh
wikititles-ja-en
wikititles-zh-en
wikimatrix-ja-zh
news-commentary-en-ja
news-commentary-en-zh
news-commentary-ja-zh
ted2020-en-ja
ted2020-en-zh
ted2020-ja-zh
License: 
- Task
- Translation
- Library
- transformers
- Type
- mt5
- License
- cc-by-nc-sa-4.0
- Languages
- zh, ja, en
- Created
- Mar 2, 2022
- Updated
- Mar 24, 2022