Downloads · 30 days
6
9% of all-time downloads
hsilvosa/hsc-wuxia-mbart-large-50
hsc-wuxia-mbart-large-50 is a translation model from hsilvosa. Use it when you need text moved from one language to another. It is set up for transformers. The card lists the license as mit.
This model is a fine-tuned sequence-to-sequence model based on facebook/mbart-large-50-many-to-many-mmt for Chinese-to-English translation of Wuxia and Xianxia literature. It was developed as part of the Bachelor's Th…
Downloads · 30 days
6
9% of all-time downloads
All-time downloads
65
Public
Parameters
611M
2.5 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors2.4 GB · 99%
From the Hugging Face model README
This model is a fine-tuned sequence-to-sequence model based on facebook/mbart-large-50-many-to-many-mmt for Chinese-to-English translation of Wuxia and Xianxia literature. It was developed as part of the Bachelor's Thesis (TFG):
"Enfoques de traducción automática con modelos de lenguaje en obras wuxia" (Degree in Data Science and Engineering, Universidade da Coruña)
This model can be used directly for Chinese-to-English translation of literary text in the Wuxia domain.
from transformers import MBartForConditionalGeneration, MBart50TokenizerFast
model_name = "HSilvosa/hsc-wuxia-mbart-large-50"
model = MBartForConditionalGeneration.from_pretrained(model_name)
tokenizer = MBart50TokenizerFast.from_pretrained(model_name)
# Set source and target language
tokenizer.src_lang = "zh_CN"
text = "一念成沧海,一念化桑田。"
encoded_zh = tokenizer(text, return_tensors="pt")
generated_tokens = model.generate(**encoded_zh, forced_bos_token_id=tokenizer.lang_code_to_id["en_XX"])
print(tokenizer.batch_decode(generated_tokens, skip_special_tokens=True)[0])
The model was evaluated on the Wuxia parallel test set, comparing the base model and the fine-tuned version:
| Metric | Base Model (mbart-large-50-...) | Fine-tuned Model (hsc-wuxia-mbart-large-50) | Delta (Improvement) |
|---|---|---|---|
| SacreBLEU | 6.33 | 37.73 | +31.40 |
| chrF | 26.73 | 56.22 | +29.49 |
| ROUGE-L | 29.26 | 62.45 | +33.19 |
| METEOR | 25.79 | 61.91 | +36.12 |
| COMET | 60.86 | 79.96 | +19.10 |
The model was fine-tuned using the following architectural training parameters:
This model and the associated training/evaluation pipelines were developed in the following project repository: