Downloads · 30 days
5
17% of all-time downloads
abir177m-balanced70-multilingual
nirmalendu01/abir177m-balanced70-multilingual
abir177m-balanced70-multilingual is a machine learning model from nirmalendu01. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Causal LM trained from scratch on a 70% English / 7.5% each (fr, de, zh, ar) mixture (FineWeb / FineWeb-2 style corpora) with the Mistral Nemo tokenizer (mistralai/Mistral-Nemo-Base-2407).
All-time downloads
30
Public
Parameters
288M
1.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors576 MB · 97%
At a glance
- License
- apache-2.0
- Model type
- gpt2
- Access
- Public
- Created
- Jun 4, 2026
- Updated
- Jun 4, 2026
- SHA
- 3e1e42e1
Base models
Model card
From the Hugging Face model README
tekken-llama1b en70 multilingual GPT-2–style LM
Causal LM trained from scratch on a 70% English / 7.5% each (fr, de, zh, ar) mixture
(FineWeb / FineWeb-2 style corpora) with the Mistral Nemo tokenizer (mistralai/Mistral-Nemo-Base-2407).
- Architecture: GPT-2–style, ~187M parameters (12 layers, 768 hidden, 2048 context).
- Training: ~14.4B tokens total (two 7.2B phases: GPUs 0–3 then 6–7); this checkpoint is the phase-2 final weights.
- Source directory:
runs/tekken_llama1b_en70_phase2
For the training setup, see the MultilingualCLTs paper codebase.
- Type
- gpt2
- License
- apache-2.0
- Languages
- en, fr, de, zh, ar
- Created
- Jun 4, 2026
- Updated
- Jun 4, 2026