paper-gmts-token-select-1.5b

paper-gmts-token-select-1.5b

Recipe: recipes/papers/gmts-token-select · Collection: Papers, replicated

GRPO on GSM8K training on 20% of the batch's tokens, ranked by entropy (baseline) or by entropy times advantage (recipe). Both arms keep the same number of tokens, so the comparison isolates which tokens, not how many.

Result

Recipe vs baseline: -0.310 [-0.383, -0.235] over 120 paired tasks. The recipe arm finished below the untrained model: mean completion length fell from 700 to 374 characters and the hack scan flagged the collapse. These weights are published as the record of that run, not as a model to use.

Arms in this repo

The root holds the arm the recipe README's headline number reports. Every other arm is a subfolder named after it. checkpoints/ never ships.

Load

from peft import PeftModel
from transformers import AutoModelForCausalLM

base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-1.5B-Instruct")
model = PeftModel.from_pretrained(base, "while-ai/paper-gmts-token-select-1.5b")  # the headline arm
model = PeftModel.from_pretrained(base, "while-ai/paper-gmts-token-select-1.5b", subfolder="baseline")  # another arm

Reproduce

git clone https://github.com/whilehq/whileai-sdk && cd whileai-sdk/recipes/papers/gmts-token-select
python recipe.py

The recipe README pins the seed, the library versions and the GPU, and its Checks table says what the eval verified. Read the Learned section before quoting a number from this card.