Downloads · 30 days
0
mzio/aprm-sft-tau2-airline
aprm-sft-tau2-airline is a machine learning model from mzio. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
LoRA adapters (r8a16, base Qwen/Qwen3-4B-Instruct-2507) from Act-PRM supervised fine-tuning on tau2-bench airline. Variants: actionsonly (baseline), expertthoughts (oracle), thoughts{policy,base}[last] (Act-PRM inferr…
Downloads · 30 days
0
Access
Public
Updated Aug 30, 2026
Repo size
1.5 GB
Likes
0
Public
Click a slice to open those files.
.safetensors1.4 GB · 100%
From the Hugging Face model README
LoRA adapters (r8_a16, base Qwen/Qwen3-4B-Instruct-2507) from Act-PRM supervised fine-tuning on tau2-bench airline. Variants: actions_only (baseline), expert_thoughts (oracle), thoughts_{policy,base}[_last] (Act-PRM inferred thoughts), each in hide-observations and full-context regimes. Adapters live under airline/<variant_regime>/.
| variant_regime | action-only PPL | action-acc |
|---|---|---|
| thoughts_policy_adamw30_lr1e_3_adamw_nb100_heldout | 2.006 | 0.808 |
See the project for methodology (Act-PRM: infer latent thoughts behind action-only demos via offline EM).