ModernBERT-base-TeleMath-router-qe-classifier-binary-10ep-lr2e-05-e2b-5runs

ymoslem/ModernBERT-base-TeleMath-router-qe-classifier-binary-10ep-lr2e-05-e2b-5runs

Quality estimator for the Stage 2 cascade of CRE-Router on TeleMath. Gemma4-E2B. Gates cluster 1 under both the TPOT and E2EL routings.

Given an efficient model's answer, it predicts whether to accept it or escalate to a stronger model.

Input format

question [SEP] full_output [SEP] num_tokens

full_output is truncated to its last 1,000 words before tokenisation, and the tokeniser runs at max_length=4096. Using 2048 truncates roughly a fifth of these inputs from the right, which removes the final answer and the token count, the two things the classifier most needs.

Training

ModernBERT-base, 10 epochs, lr 2e-5, max_length 4096, on the train_e2b split of ymoslem/TeleMath-router. Labels are recomputed from the saved generation text with the current grader, so they carry no dependence on the answer parser that was in use when the generations were produced.

Intended use

Deployed only where Stage 1 gates to the corresponding tier. It is trained on that tier's own outputs and does not transfer to another model's outputs.