Downloads · 30 days
5
14% of all-time downloads
llama3-7b-en1-en2-134k
The-CoLab/llama3-7b-en1-en2-134k
llama3-7b-en1-en2-134k is a machine learning model from The-CoLab. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.
LLaMA-3 7B pretrained on English bilingual data (en1 + en2), 134k total steps. Uses a 2×vocabulary (65k paired tokenizer) with separate en1/en2 token spaces.
All-time downloads
36
Public
Parameters
6.3B
12.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors12.6 GB · 100%
At a glance
- License
- llama3
- Model type
- llama
- Access
- Public
- Created
- Aug 12, 2026
- Updated
- Aug 12, 2026
- SHA
- c7df2ef0
Model card
From the Hugging Face model README
llama3-7b-en1-en2-134k
LLaMA-3 7B pretrained on English bilingual data (en1 + en2), 134k total steps. Uses a 2×vocabulary (65k paired tokenizer) with separate en1/en2 token spaces.
Validation Results
Final checkpoint: step 133,600
| Validation set | Cross-entropy loss (nats) | Perplexity |
|---|---|---|
| English 1 (en1) | 2.4598 | 11.70 |
| English 2 (en2) | 2.5351 | 12.62 |
Training Curves
Training and validation loss curves are in training_curves/:
train_en1_en2_134k.csv— step, train_lossval_en1_en2_134k.csv— step, lang, val_loss
Evaluation Results
EEE-format evaluation results are stored under eval_results/eee/ in this repository.
Tasks: Global MMLU (EN), PIQA, ECLeKTic, Fictive Entity (2-rate mix).
Citation
Part of the The-CoLab multilingual-transfer collection.
- Type
- llama
- License
- llama3
- Languages
- en
- Created
- Aug 12, 2026
- Updated
- Aug 12, 2026