xlmr-vinli-finetune-full-6k

🧠 XLM-RoBERTa for Vietnamese NLI — Full 6K Finetune

Fine-tuned XLM-RoBERTa-base model for Vietnamese Natural Language Inference (NLI) — trained on a manually curated and balanced dataset of ~6k premise–hypothesis pairs. The model predicts one of three labels:

• c → Contradiction
• n → Neutral
• e → Entailment

---

🚀 Overview

---

📚 Dataset

The dataset (full_data_true_conflict.json) includes Vietnamese NLI pairs with carefully normalized labels:

Each record:

{
  "id": "example_001",
  "premise": "Anh ấy đang chơi bóng đá trên sân.",
  "hypothesis": "Anh ấy đang tham gia một môn thể thao.",
  "label": "e"
}

⚙️ Training Configuration

Environment:

• CUDA 12.4
• Transformers 4.43.3
• PyTorch 2.3.0+cu124
• Kaggle P100 GPU

🧩 Model Performance

Confusion Matrix (Test)

Classification Report (Test)

---

🧪 Usage Example

from transformers import AutoTokenizer, AutoModelForSequenceClassification
import torch

model_name = "lyle49/xlmr-vinli-finetune-full-6k"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForSequenceClassification.from_pretrained(model_name)

premise = "Anh ấy đang chơi bóng đá trên sân."
hypothesis = "Anh ấy đang tham gia một môn thể thao."
inputs = tokenizer(premise, hypothesis, return_tensors="pt", truncation=True, max_length=256)

with torch.no_grad():
    outputs = model(**inputs)
    probs = torch.softmax(outputs.logits, dim=-1)
    label = model.config.id2label[probs.argmax().item()]

print(f"Prediction: {label} ({probs.max().item():.3f})")

Output:

Prediction: e (0.980)

🧭 Notes

• The model achieves ~98% accuracy on a balanced Vietnamese NLI test set.
• It is robust for figurative / paraphrased sentence pairs and works well on both formal and informal text.
• For extended use (e.g., paraphrase detection, contradiction filtering, or multi-lingual entailment), consider fine-tuning with domain data.
• Model is saved as .safetensors for safety and compatibility.

🏷️ Citation

If you use this model in research or product, please cite:

@misc{lyle49_xlmr_vinli_2025,
  author = {Lê, Lý},
  title = {XLM-RoBERTa for Vietnamese NLI — Full 6K Finetune},
  year = {2025},
  publisher = {Hugging Face},
  howpublished = {\url{https://huggingface.co/lyle49/xlmr-vinli-finetune-full-6k}}
}

🧰 Files in Repository

---

⭐ Created by @lyle49 — part of the Vietnamese Figurative NLI Project (2025).