Downloads · 30 days
3
4% of all-time downloads
llama3-7b-en-anchored-ar-v2
The-CoLab/llama3-7b-en-anchored-ar-v2
llama3-7b-en-anchored-ar-v2 is a machine learning model from The-CoLab. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.
LLaMA-3 7B pretrained on English-Arabic bilingual data with anchored training, 134k steps (injection fix v2).
All-time downloads
70
Public
Parameters
6.3B
12.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors12.6 GB · 100%
At a glance
- License
- llama3
- Model type
- llama
- Access
- Public
- Created
- Jul 24, 2026
- Updated
- Aug 8, 2026
- SHA
- 2e160448
Model card
From the Hugging Face model README
llama3-7b-en-anchored-ar-v2
LLaMA-3 7B pretrained on English-Arabic bilingual data with anchored training, 134k steps (injection fix v2).
Validation Results
Final checkpoint: step 133,600
| Validation set | Cross-entropy loss (nats) | Perplexity |
|---|---|---|
| English (en) | 2.267 | 9.65 |
AR (ar) | 2.8797 | 17.81 |
Note: Rerun with corrected injection config (Buckwalter transliteration fix + injection count fix).
Evaluation Results
EEE-format evaluation results are stored under eval_results/eee/ in this repository.
Tasks: Global MMLU (EN/AR), PIQA, ECLeKTic, Fictive Entity (2-rate mix).
Citation
Part of the The-CoLab multilingual-transfer collection.
Training Curves
Per-step training and validation loss curves are stored in training_curves/:
| File | Description |
|---|---|
train_loss.csv | Training loss every 10 steps (step,train_loss) |
val_loss.csv | Validation loss per language (step,lang,val_loss) |
- Type
- llama
- License
- llama3
- Languages
- en, ar
- Created
- Jul 24, 2026
- Updated
- Aug 8, 2026