Downloads · 30 days
6
11% of all-time downloads
The-CoLab/llama3-7b-en1-en2-baseline
llama3-7b-en1-en2-baseline is a machine learning model from The-CoLab. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.
LLaMA-3 7B pretrained on English (en1 + en2) bilingual data, 34k steps.
Downloads · 30 days
6
11% of all-time downloads
All-time downloads
56
Public
Parameters
6.3B
12.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors12.6 GB · 100%
From the Hugging Face model README
LLaMA-3 7B pretrained on English (en1 + en2) bilingual data, 34k steps.
Final checkpoint: step 33,400
| Metric | Value |
|---|---|
| Validation language | en2 |
| Cross-entropy loss (nats) | 2.4644 |
| Perplexity | 11.76 |
EEE-format evaluation results are stored under eval_results/eee/ in this repository.
Tasks: Global MMLU (EN/AR/RU), PIQA, ECLeKTic, Fictive Entity (2-rate mix).
Part of the The-CoLab multilingual-transfer collection.