Downloads · 30 days
26
8% of all-time downloads
HiTZ/mt5-counter-narrative-eu
mt5-counter-narrative-eu is a text generation model from HiTZ. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Content Warning: This card may contain examples of offensive language that do not reflect the authors’ views
Downloads · 30 days
26
8% of all-time downloads
All-time downloads
313
Public
Repo size
4.7 GB
Likes
0
Public
Click a slice to open those files.
.bin2.3 GB · 99%
From the Hugging Face model README
Content Warning: This card may contain examples of offensive language that do not reflect the authors’ views
This is a fine-tuned text-to-text mT5-base model to generate counternarratives against hate speech in Basque. The model has been fine-tuned on the Basque splits of the CONAN-EUS dataset.
CONAN-EUS was created by professionally translating all 6654 English HS-CN pairs of the original CONAN dataset into Basque and Spanish. For experimentation we generated train, validation and test splits in a way that no HS-CN pairs occurred across them.
<table style="width:33%"> <tr> <th>CONAN-EUS Splits</th> <th>Total HS-CN Count</th> <tr> <td>train</td> <td>4833</td> </tr> <tr> <td>validation</td> <td>537</td> </tr> <tr> <td>test</td> <td>1278</td> </tr> </table>The CONAN dataset includes HS-CN pairs, regarding the topic of Muslims and Islam. An example of a HS-CN pair in Basque, Spanish and English is illustrated below:
| HS | CN |
|---|---|
| Musulmanok ez dugu gure kultura aberastu dezakeen ezer erabilgarririk. | Zer egin dute guretzat musulmanek? Beno, kafea, erlojuak, kamerak, higienea, unibertsitateak, tresna kirurgikoak, mapak, musika, aljebra. |
| Los musulmanes no tienen nada útil que pueda enriquecer nuestra cultura. | ¿Qué han hecho los musulmanes por nosotros? Bueno, café, relojes, cámaras, higiene, universidades, instrumentos quirúrgicos, mapas, música, álgebra. |
| Muslims do not have anything useful that can enrich our culture. | What have Muslims ever done for us? Well, Coffee, Clocks, Cameras, Hygiene, Universities, Surgical Instruments, Maps, Music, Algebra. |
If you use the model please cite the following paper:
@inproceedings{bengoetxea-et-al-2024,
title={{B}asque and {S}panish {C}ounter {N}arrative {G}eneration: {D}ata {C}reation and {E}valuation},
author={Jaione Bengoetxea and Yi-Ling Chung and Marco Guerini and Rodrigo Agerri},
year={2024},
publisher = "Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING)",
}
Contact: Rodrigo Agerri HiTZ Center - Ixa, University of the Basque Country UPV/EHU