Downloads · 30 days
3
20% of all-time downloads
llama3-7b-en-ru-v2
sn0vo/llama3-7b-en-ru-v2
llama3-7b-en-ru-v2 is a machine learning model from sn0vo. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.
LLaMA-3 7B pretrained on English-Russian bilingual data, 134k steps (injection fix v2).
All-time downloads
15
Public
Parameters
6.3B
12.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors12.6 GB · 100%
At a glance
- License
- llama3
- Model type
- llama
- Access
- Public
- Created
- Aug 8, 2026
- Updated
- Aug 8, 2026
- SHA
- 6d17fee8
Model card
From the Hugging Face model README
llama3-7b-en-ru-v2
LLaMA-3 7B pretrained on English-Russian bilingual data, 134k steps (injection fix v2).
Validation Results
Final checkpoint: step 133,600
(Validation losses below are from step 70,808 — the last checkpoint before a training run restart caused log rotation.)
| Validation set | Cross-entropy loss (nats) | Perplexity |
|---|---|---|
| English (en) | 1.273 | 3.57 |
RU (ru) | 0.9411 | 2.56 |
Note: Rerun with corrected injection config (Buckwalter transliteration fix + injection count fix). The training run was restarted from a mid-run checkpoint; the final step-133600 validation loss was not captured in logs due to log rotation during the restart. Reported validation losses are from the last logged checkpoint (step 70,808).
Evaluation Results
EEE-format evaluation results are stored under eval_results/eee/ in this repository.
Tasks: Global MMLU (EN/RU), PIQA, ECLeKTic, Fictive Entity (2-rate mix).
Citation
Part of the The-CoLab multilingual-transfer collection.
- Type
- llama
- License
- llama3
- Languages
- en, ru
- Created
- Aug 8, 2026
- Updated
- Aug 8, 2026