LFM2.5-1.2B-AfriBase

🌍 Pan-African Language Model (1.2B)

This model extends the LFM2.5-1.2B base model with a massively expanded vocabulary optimized for African languages, achieving state-of-the-art tokenization efficiency across 8 languages.

🚀 Model Details

• Size: 1.2B parameters
• Base vocab: 64,400
• Extended vocab: 110,397
• Embedding dim: 2048

📊 Vocabulary Extension

🏆 Tokenization Performance

💡 Key Achievements

• ✅ 7/9 languages achieve EXCELLENT tokenization (>3.0 chars/token)
• ✅ 0/9 languages perform poorly (<1.0 chars/token)
• ✅ 6.25 chars/token on Oromo - world-class efficiency
• ✅ 5.00 chars/token on Amharic - 12x better than base model
• ✅ 4.50 chars/token on English - beats English-only models
• ✅ 4.89 chars/token on code-switching - perfect for real-world use

🛠️ Usage

from transformers import AutoTokenizer, AutoModelForCausalLM

# Load model and tokenizer
tokenizer = AutoTokenizer.from_pretrained("NaolBM/LFM2.5-1.2B-AfriBase")
model = AutoModelForCausalLM.from_pretrained("NaolBM/LFM2.5-1.2B-AfriBase")

# Test in any African language
text = "አማርኛ ቋንቋ በኢትዮጵያ"  # Amharic
# text = "Kiswahili ni lugha ya Kibantu"  # Swahili
# text = "Hausa yare ne na Afro-Asiatic"  # Hausa

tokens = tokenizer.tokenize(text)
print(f"Tokens: {len(tokens)}")
print(f"Chars/token: {len(text)/len(tokens):.2f}")

📈 Performance vs Other Models

Our model is 2-4x more efficient than leading alternatives! 🏆

📜 Citation

@misc{naol2026panafrican,
  title={Pan-African Language Model: A 1.2B Parameter LLM Optimized for African Languages},
  author={Naol},
  year={2026},
  howpublished={\url{https://huggingface.co/NaolBM/LFM2.5-1.2B-AfriBase}},
}

🙏 Acknowledgments

• Built with 🤗 Hugging Face Transformers
• Trained using Unsloth for optimal performance
• Inspired by the need for better African language AI

---

<div align="center"> <h3>⭐ If you find this model useful, please star the repo! ⭐</h3> <p>Made with ❤️ for African AI</p> </div>