Downloads · 30 days
8
14% of all-time downloads
burtenshaw/openenv-echo-world-model-distilgpt2-seed2
openenv-echo-world-model-distilgpt2-seed2 is a text generation model from burtenshaw. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This checkpoint was trained with examples/echoworldmodel/trainecho.py to predict OpenEnv terminal environment outputs from verifier-free ECHO loss.
Downloads · 30 days
8
14% of all-time downloads
All-time downloads
58
Public
Parameters
81.9M
328 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors328 MB · 99%
From the Hugging Face model README
This checkpoint was trained with examples/echo_world_model/train_echo.py to
predict OpenEnv terminal environment outputs from verifier-free ECHO loss.
| metric | value |
|---|---|
best_step | 35 |
heldout_ce_after | 0.26466473937034607 |
heldout_ce_before | 6.246147632598877 |
heldout_ce_delta | -5.981482893228531 |
heldout_ce_improvement_pct | 95.76275242056317 |
heldout_token_acc_after | 0.8421052631578947 |
heldout_token_acc_before | 0.10526315789473684 |
lr | 5e-05 |
model | distilgpt2 |
seed | 2 |
steps | 60 |