Qwen3-4B-OT3-if

Qwen3-4B-OT3-if

The Instruction Following domain teacher of No Pain, More Gain: Iterative Merging for Effective Multi-Teacher On-Policy Distillation (code).

Training

Evaluation

IFBench prompt-level loose accuracy 59.4 (avg@3: three samples per prompt with seeds 42-44, temperature 1.0, top-p 1.0, 32,768-token completion cap).

Format

Qwen3 chat template in thinking mode. The reasoning follows the OpenThoughts3 format: the assistant turn starts with <think> (one space) and the reasoning, then \n</think>\n\n and the answer.

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

repo = "MMOPD/Qwen3-4B-OT3-if"
tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(repo, dtype="auto", device_map="auto")
messages = [{"role": "user", "content": "..."}]
text = tok.apply_chat_template(messages, tokenize=False, add_generation_prompt=True, enable_thinking=True)
out = model.generate(**tok(text, return_tensors="pt").to(model.device), max_new_tokens=32768,
                     do_sample=True, temperature=1.0, top_p=1.0)
print(tok.decode(out[0], skip_special_tokens=True))

Citation

@article{kim2026immopd,
  title   = {No Pain, More Gain: Iterative Merging for Effective Multi-Teacher On-Policy Distillation},
  author  = {Kim, Seonghyeon and Jang, Chaeyun and Lee, Noah and Kim, Boseop and Lee, Juho},
  journal = {arXiv preprint arXiv:2609.34745},
  year    = {2026}
}