Downloads · 30 days
6
11% of all-time downloads
burtenshaw/openenv-echo-world-model-distilgpt2-seed1
openenv-echo-world-model-distilgpt2-seed1 is a text generation model from burtenshaw. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This checkpoint was trained with examples/echoworldmodel/trainecho.py to predict OpenEnv terminal environment outputs from verifier-free ECHO loss.
Downloads · 30 days
6
11% of all-time downloads
All-time downloads
56
Public
Parameters
81.9M
328 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors328 MB · 99%
From the Hugging Face model README
This checkpoint was trained with examples/echo_world_model/train_echo.py to
predict OpenEnv terminal environment outputs from verifier-free ECHO loss.
| metric | value |
|---|---|
best_step | 45 |
heldout_ce_after | 0.26160934567451477 |
heldout_ce_before | 6.333791732788086 |
heldout_ce_delta | -6.072182387113571 |
heldout_ce_improvement_pct | 95.8696250727626 |
heldout_token_acc_after | 0.8947368421052632 |
heldout_token_acc_before | 0.10526315789473684 |
lr | 5e-05 |
model | distilgpt2 |
seed | 1 |
steps | 60 |