rost-73m-en-baseline

stefaniancu/rost-73m-en-baseline

73M parameter nanochat GPT (base stage), research tag d6, checkpoint step 001062.

Part of the rost model zoo — the full set of trained variants behind the rost research series, published for reproducibility. This is a research model, not a product.

The English control model (research tag d6, experiment 000): the same recipe with no Romanian at all, used as the reference point for every bilingual arm.

Validation bits-per-byte is measured on this arm's own validation split and is not comparable across arms — cross-arm comparisons in the rost write-ups are always cross-evaluated on identical text.

Licence

CC-BY-NC-4.0, non-commercial, inherited from the most restrictive component of the training data.