rubert-large-tatar-toponyms-qa

⭐ RuBERT Large for Tatar Toponyms QA

📖 Model Description

RuBERT large fine-tuned for question answering on Tatarstan toponyms. This model requires simple post-processing for coordinates to achieve optimal results.

This model is fine-tuned from Den4ikAI/rubert_large_squad_2 on a synthetic dataset of 38,696 QA pairs about Tatarstan geographical names.

⚠️ Important Note

This model adds extra spaces in coordinate answers (e.g., "55. 175195" instead of "55.175195"). This is a known behavior of RuBERT tokenizers. Use the simple normalization function below to fix this.

📊 Performance Metrics

Raw Model Output (without normalization)

With Simple Normalization

📈 Performance by Question Type (with normalization)

🔧 Simple Normalization (One Line of Code!)

Add this after getting predictions from the model:

import re

def normalize_answer(text, question_type="coordinates"):
    """
    Simple normalization for RuBERT models
    """
    # Fix coordinates: "55. 175195" -> "55.175195"
    if question_type == "coordinates":
        text = re.sub(r'(\d+)\.\s+(\d+)', r'\1.\2', text)
        text = re.sub(r'(\d+)\s+\.\s*(\d+)', r'\1.\2', text)
    
    # Fix location: "северо - западу" -> "северо-западу"
    if question_type == "location":
        text = re.sub(r'\s*-\s*', '-', text)
        text = re.sub(r'\(\s+', '(', text)
        text = re.sub(r'\s+\)', ')', text)
    
    return text

# Example usage
predicted = "55. 175195, 58. 709845"  # raw model output
normalized = normalize_answer(predicted, "coordinates")
print(normalized)  # "55.175195, 58.709845" ✅

🚀 Quick Start

With Pipeline and Normalization

from transformers import pipeline
import re

# Load model
qa_pipeline = pipeline(
    "question-answering",
    model="TatarNLPWorld/rubert-large-tatar-toponyms-qa"
)

# Normalization function
def normalize_answer(text, question_type="coordinates"):
    if question_type == "coordinates":
        text = re.sub(r'(\d+)\.\s+(\d+)', r'\1.\2', text)
        text = re.sub(r'(\d+)\s+\.\s*(\d+)', r'\1.\2', text)
    if question_type == "location":
        text = re.sub(r'\s*-\s*', '-', text)
        text = re.sub(r'\(\s+', '(', text)
        text = re.sub(r'\s+\)', ')', text)
    return text

# Example
context = """
Название (рус): Рантамак | Объект: Село | 
Расположение: на р. Мелля, в 21 км к востоку от с. Сарманово | 
Координаты: 55.205461, 52.881862
"""

questions = [
    ("Где находится Рантамак?", "location"),
    ("Какие координаты у Рантамак?", "coordinates"),
    ("Что такое Рантамак?", "type")
]

for question, qtype in questions:
    result = qa_pipeline(question=question, context=context)
    normalized = normalize_answer(result['answer'], qtype)
    print(f"Q: {question}")
    print(f"A (raw): {result['answer']}")
    print(f"A (norm): {normalized}")
    print(f"Confidence: {result['score']:.3f}\n")

With PyTorch

from transformers import AutoTokenizer, AutoModelForQuestionAnswering
import torch
import re

# Load model
tokenizer = AutoTokenizer.from_pretrained("TatarNLPWorld/rubert-large-tatar-toponyms-qa")
model = AutoModelForQuestionAnswering.from_pretrained("TatarNLPWorld/rubert-large-tatar-toponyms-qa")
device = "cuda" if torch.cuda.is_available() else "cpu"
model = model.to(device)

# Normalization function
def normalize_answer(text, question_type="coordinates"):
    if question_type == "coordinates":
        text = re.sub(r'(\d+)\.\s+(\d+)', r'\1.\2', text)
        text = re.sub(r'(\d+)\s+\.\s*(\d+)', r'\1.\2', text)
    return text

# Inference
inputs = tokenizer(question, context, return_tensors="pt").to(device)
with torch.no_grad():
    outputs = model(**inputs)

start_idx = torch.argmax(outputs.start_logits)
end_idx = torch.argmax(outputs.end_logits)
answer = tokenizer.decode(inputs["input_ids"][0][start_idx:end_idx+1], skip_special_tokens=True)
normalized = normalize_answer(answer, "coordinates")
print(f"Answer: {normalized}")

📚 Training Details

Dataset

• Source: Tatarstan Toponyms Dataset
• QA pairs: 38,696 synthetic examples
• Train/Validation/Test split: 80%/10%/10%
• Question types: coordinates, location, etymology, type, region, sources

Training Parameters

💡 Known Issues & Solutions

Issue 1: Extra spaces in coordinates

Problem: Model outputs "55. 175195" instead of "55.175195" Solution:

import re
text = re.sub(r'(\d+)\.\s+(\d+)', r'\1.\2', text)

Issue 2: Spaces around hyphens in location

Problem: "северо - западу" instead of "северо-западу" Solution:

text = re.sub(r'\s*-\s*', '-', text)

Issue 3: Spaces inside parentheses

Problem: "( текст )" instead of "(текст)" Solution:

text = re.sub(r'\(\s+', '(', text)
text = re.sub(r'\s+\)', ')', text)

🔗 Related Resources

Models in Collection

Datasets

• Tatarstan Toponyms QA Dataset - Training data
• Tatarstan Toponyms Dataset - Original data

⚡ Performance Comparison

🎯 When to Use This Model

• Need speed: 3.5x faster than XLM-RoBERTa
• Resource constraints: Smaller memory footprint
• Can add post-processing: Simple regex fixes
• Russian-focused tasks: Optimized for Russian text

📝 Citation

If you use this model in your research, please cite:

@model{rubert_large_tatar_toponyms_qa,
    author = {Arabov, Mullosharaf Kurbonvoich},
    title = {RuBERT Large for Tatar Toponyms QA},
    year = {2026},
    publisher = {Hugging Face},
    howpublished = {\url{https://huggingface.co/TatarNLPWorld/rubert-large-tatar-toponyms-qa}}
}

👥 Team and Maintenance

• Developer: Mullosharaf Kurbonvoich Arabov
• Organization: TatarNLPWorld
• Project: Tat2Vec

🤝 Contributing

Contributions welcome! Please:

1. Open issues for bugs
2. Submit PRs for improvements
3. Share your use cases

---

📅 Version: 1.0.0 | 📅 Published: 2026-03-10 | ⚡ Speed: 6.5ms | 🔧 Post-processing: Required