Downloads · 30 days
7
4% of all-time downloads
mikaberidze/xlmr-large-sib200-peft-spt-seen
xlmr-large-sib200-peft-spt-seen is a machine learning model from mikaberidze. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
This model is released as part of the paper: Cross-Prompt Encoder for Low-Performing Languages Findings of IJCNLP–AACL 2025; preprint at arXiv:2508.10352.
Downloads · 30 days
7
4% of all-time downloads
All-time downloads
177
Public
Repo size
43.1 MB
Likes
0
Public
Click a slice to open those files.
.safetensors4.3 MB · 100%
From the Hugging Face model README
This model is released as part of the paper:
Cross-Prompt Encoder for Low-Performing Languages
Findings of IJCNLP–AACL 2025; preprint at arXiv:2508.10352.
The paper studies cross-lingual transfer learning for low-performing languages using parameter-efficient, prompt-based methods on the SIB-200 benchmark.
This repository provides the trained Standard Soft Prompt (SPT) adapter used in the study. It is a parameter-efficient soft-prompt model designed to be loaded on top of a frozen XLM-R (large) backbone, and contains the learned:
Soft Prompt
Classification Head
FacebookAI/xlm-roberta-largeDavlan/sib200This repository includes 10 models trained with different random seeds.
The main branch corresponds to seed-01
Models for other seeds are available as branches: seed-02, seed-03, …, seed-10
This model is part of the experimental framework introduced in the paper and is intended to be loaded and used via its canonical codebase.
Cross-Prompt Encoder for Low-Performing Languagesbmikaberidze/XPEDavlan/sib200mikaberidze/sib200-xlmr-tokenizedIf you use this model, please cite:
@misc{mikaberidze2025crosspromptencoderlowperforminglanguages,
title = {Cross-Prompt Encoder for Low-Performing Languages},
author = {Beso Mikaberidze and Teimuraz Saghinadze and Simon Ostermann and Philipp Muller},
year = {2025},
eprint = {2508.10352},
archivePrefix = {arXiv},
primaryClass = {cs.CL},
url = {https://arxiv.org/abs/2508.10352},
}
Beso Mikaberidze — [email protected]
Philipp Muller — [email protected]