Downloads · 30 days
6
6% of all-time downloads
ltg/mt0-definition-ru-xl-axolotl24st
mt0-definition-ru-xl-axolotl24st is a machine learning model from ltg. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as cc-by-sa-4.0.
This model is a version of bigscience/mt0-xl, fine-tuned on datasets of Russian usage examples and definitions.
Downloads · 30 days
6
6% of all-time downloads
All-time downloads
101
Public
Repo size
4.6 GB
Likes
0
Public
Click a slice to open those files.
.safetensors4.6 GB · 100%
From the Hugging Face model README
This model is a version of bigscience/mt0-xl, fine-tuned on datasets of Russian usage examples and definitions.
It generates definitions of Russian words in context. Its input is the usage example and the instruction question "Что такое <target word>?"
Tower, axolotl24 Tower, axolotl24 + dbnary
mT0-xl, axolotl24 mT0-xl, axolotl24 + dbnary
aya-101, axolotl24 aya-101, axolotl24 + dbnary
Tower, axolotl24 Tower, axolotl24 + dbnary
mT0-xl, axolotl24 mT0-xl, axolotl24 + dbnary
aya-101, axolotl24 aya-101, axolotl24 + dbnary
The model is intended for research purposes, as a source of contextualized dictionary-like lexical definitions.
The fine-tuning datasets were limited to Russian. Although the original model is multilingual, we did not evaluate its ability to generate definitions in other languages.
Generated definitions can contain all sorts of biases and stereotypes, stemming from the underlying language model and raw dictionary data.
BLEU, BERTScore
BibTeX:
@inproceedings{fedorova-etal-2025-explaining,
title = "Explaining novel senses using definition generation with open language models",
author = "Fedorova, Mariia and
Kutuzov, Andrey and
Periti, Francesco and
Scherrer, Yves",
editor = "Christodoulopoulos, Christos and
Chakraborty, Tanmoy and
Rose, Carolyn and
Peng, Violet",
booktitle = "Findings of the Association for Computational Linguistics: EMNLP 2025",
month = nov,
year = "2025",
address = "Suzhou, China",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2025.findings-emnlp.1214/",
pages = "22294--22302",
ISBN = "979-8-89176-335-7",
abstract = "We apply definition generators based on open-weights large language models to the task of creating explanations of novel senses, taking target word usages as an input. To this end, we employ the datasets from the AXOLOTL{'}24 shared task on explainable semantic change modeling, which features Finnish, Russian and German languages. We fine-tune and provide publicly the open-source models performing higher than the best submissions of the aforementioned shared task, which employed closed proprietary LLMs. In addition, we find that encoder-decoder definition generators perform on par with their decoder-only counterparts."
}
bert-score==0.3.13
peft==0.14.0
sentencepiece==0.2.0
tokenizers==0.20.1
torch==2.2.2
transformers==4.46.1
trl==0.15.2