Downloads · 30 days
45
8% of all-time downloads
KonradBRG/xlm-mlm-plains-cree-en-tlm
xlm-mlm-plains-cree-en-tlm is a fill-mask model from KonradBRG. Use it when you need the model to fill a missing word. The card lists the license as cc-by-4.0.
FacebookAI/xlm-mlm-100-1280 fine-tuned with the Translation Language Modeling (TLM) objective on a Plains Cree–English parallel corpus.
Downloads · 30 days
45
8% of all-time downloads
All-time downloads
590
Public
Parameters
572M
59.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors2.3 GB · 100%
From the Hugging Face model README
FacebookAI/xlm-mlm-100-1280 fine-tuned with the Translation Language Modeling (TLM) objective on a Plains Cree–English parallel corpus.
Fine-tuned using the TLM objective introduced in Lample & Conneau (2019). Cree–English sentence pairs are concatenated and masked jointly, encouraging the model to use cross-lingual context when predicting masked tokens. Trained jointly with an InfoNCE alignment loss (alpha=0.2, temperature=0.05) that explicitly pulls Cree and English sentence representations together.
Training data: Bloomfield (1934) Plains Cree texts (scraped and sentence-aligned) + EdTeKLA parallel corpus (~9,000 sentence pairs total) Epochs: 15 | Batch size: 16 | Max length: 256 Hardware: 1× NVIDIA A100 40 GB
This checkpoint serves as the student encoder foundation for Cross-Lingual Knowledge Distillation (CLKD) of figurative language classifiers into Plains Cree.
If you use this model, please cite the associated thesis/paper (TBD).
Training data includes: