Downloads · 30 days
6
33% of all-time downloads
rost-126m-sft
stefaniancu/rost-126m-sft
rost-126m-sft is a machine learning model from stefaniancu. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-4.0.
126M parameter nanochat GPT (sft stage), research tag ro30, checkpoint step 000600.
All-time downloads
18
Public
Repo size
336 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt336 MB · 100%
At a glance
- License
- cc-by-nc-4.0
- Model type
- nanochat-gpt
- Access
- Public
- Created
- Aug 2, 2026
- Updated
- Oct 22, 2026
- SHA
- 4d707b38
Model card
From the Hugging Face model README
stefaniancu/rost-126m-sft
126M parameter nanochat GPT (sft stage), research tag ro30, checkpoint step 000600.
Part of the rost model zoo — the full set of trained variants behind the rost research series, published for reproducibility. This is a research model, not a product.
| architecture | nanochat GPT, 8 layers, 512 embed, 2048 context |
| tokenizer | included under tokenizer/ (32,768 vocab) |
| training mixture | Romanian SFT mixture (OpenLLM-Ro) with 25% English (--english-frac 0.25) |
| stage | sft |
| val bpb (own split) | 0.48868 |
The best bilingual conversational model of the rost small series (research tag ro30, experiment 004d): English in, English out; Romanian in, Romanian out. Its sibling trained without the English fraction answered everything in Romanian — the 'SFT language decides output language' finding.
Validation bits-per-byte is measured on this arm's own validation split and is not comparable across arms — cross-arm comparisons in the rost write-ups are always cross-evaluated on identical text.
Licence
CC-BY-NC-4.0, non-commercial, inherited from the most restrictive component of the training data.
- Type
- nanochat-gpt
- License
- cc-by-nc-4.0
- Languages
- ro, en
- Created
- Aug 2, 2026
- Updated
- Oct 22, 2026