ZamAI-mT5-Pashto

ZamAI mT5 Pashto

Task: text2text-generation
Languages: ps
Base model: google/mt5-base

Overview

This model is part of the ZamAI Pashto language AI collection. It is fine-tuned/adapted for text2text-generation in Pashto and related languages.

Intended uses & limitations

• Use for research, prototyping, and production assistance in Pashto NLP.
• Evaluate outputs carefully before deploying in high-stakes applications.
• May reflect biases present in the pre-training or fine-tuning data.

How to use

from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "tasal9/ZamAI-mT5-Pashto"
model = AutoModelForCausalLM.from_pretrained(model_id, trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)

prompt = "سلام دې وي! تاسو څنګه یاست؟"
inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=128, do_sample=True, temperature=0.7)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Training data

Training dataset details will be added here.

Evaluation

Update this table with your measured results and link to the evaluation script/notebook.

Citation

@misc{zamai_pashto,
  title = {{ZamAI mT5 Pashto}},
  author = {ZamAI / Yaqoob Tasal},
  year = {2024},
  howpublished = {\url{https://huggingface.co/tasal9/ZamAI-mT5-Pashto}}
}

License

This model is released under the "apache-2.0" license.