Downloads · 30 days
10
22% of all-time downloads
llama3-7b-en-ru-v4
The-CoLab/llama3-7b-en-ru-v4
llama3-7b-en-ru-v4 is a machine learning model from The-CoLab. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.
LLaMA-3 7B pretrained on English-Russian bilingual data, 133,600 total steps (v4 run). Uses a shared 65k English-Russian tokenizer (65ken1.0ru1.0).
All-time downloads
45
Public
Parameters
6.3B
12.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors12.6 GB · 100%
At a glance
- License
- llama3
- Model type
- llama
- Access
- Public
- Created
- Aug 28, 2026
- Updated
- Aug 28, 2026
- SHA
- 9875edf8
Model card
From the Hugging Face model README
llama3-7b-en-ru-v4
LLaMA-3 7B pretrained on English-Russian bilingual data, 133,600 total steps (v4 run).
Uses a shared 65k English-Russian tokenizer (65k_en1.0_ru1.0).
Validation Results
Last validation: step 133,600
| Validation set | Cross-entropy loss (nats) | Perplexity |
|---|---|---|
| English (en) | 2.2378 | 9.37 |
| Russian (ru) | 2.2127 | 9.14 |
Training Curves
Training and validation loss curves are in training_curves/:
train_en_ru_v4.csv— step, train_loss (12,594 entries, steps 10–133,600)val_en_ru_v4.csv— step, lang, val_loss (95 checkpoints × 2 languages)
Evaluation Results
EEE-format evaluation results are stored under eval_results/eee/ in this repository.
Tasks: Global MMLU (EN), Global MMLU (RU), PIQA, ECLeKTic.
Related Models
The-CoLab/llama3-7b-en-ru-v3— v3 run
Citation
Part of the The-CoLab multilingual-transfer collection.
- Type
- llama
- License
- llama3
- Languages
- en, ru
- Created
- Aug 28, 2026
- Updated
- Aug 28, 2026