kikuyu-translator-final

Kikuyu Translator (Final)

A fine-tuned translation model for English ↔ Kikuyu (Gĩkũyũ) language translation.

Model Description

This model is based on Gemma 3 4B and fine-tuned on a diverse collection of parallel Kikuyu-English data. It supports bidirectional translation between English and Kikuyu.

Training Pipeline

This model was trained through 4 progressive stages over multiple days:

Total Training Time: ~55+ hours

Final Stage Training Data

Training Configuration

• Base Model: google/gemma-3-4b-it
• Fine-tuning: LoRA (r=16, α=16)
• Learning Rate: 2e-5 (final stage)
• Hardware: NVIDIA A10G (24GB VRAM)
• Final Loss: 0.746

Usage

from unsloth import FastModel
from unsloth.chat_templates import get_chat_template

model, tokenizer = FastModel.from_pretrained(
    "InterstellarCG/kikuyu-translator-final",
    max_seq_length=2048,
    load_in_4bit=True,
)
tokenizer = get_chat_template(tokenizer, chat_template="gemma-3")

# English to Kikuyu
messages = [{"role": "user", "content": "Translate the following English text to Kikuyu.\n\nThe government announced new policies to support farmers."}]
inputs = tokenizer.apply_chat_template(messages, tokenize=True, add_generation_prompt=True, return_tensors="pt")
outputs = model.generate(input_ids=inputs, max_new_tokens=200, temperature=0.3)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Example Translations

Limitations

• Model may have bias towards religious vocabulary due to training data composition
• Best results on formal/written language; colloquial speech may vary
• Diacritics (ĩ, ũ) handling should be verified for specific use cases

License

This model is released under CC-BY-NC-4.0. The training data includes multiple sources with varying licenses - please check the dataset repository for details.

Citation

If you use this model, please cite:

@misc{interstellarcg-kikuyu-translator-2025,
  author = {InterstellarCG},
  title = {Kikuyu Translator Final},
  year = {2025},
  publisher = {Hugging Face},
  url = {https://huggingface.co/InterstellarCG/kikuyu-translator-final}
}