tinker-qwen3.5-9b-native-sft-step-2888

Native Tinker-style SFT: last durable checkpoint, step 2888

This is the last committed LoRA adapter from our Axolotl SFT run on OpenThoughts3, converted to stock-Qwen3.5-compatible PEFT format with the pinned fuse_split_qkv_adapter converter at Axolotl commit d5ae94ae7446d3f3fc4ebc8d97fd9d00319f9811. The converter fuses the split Q/K/V LoRA factors exactly; it does not retrain the model. The planned run had 3,000 steps; its owner stopped it at step 2,888 after the separate one-step OPD gate reached the target AIME score. This adapter was not the starting point of that OPD gate. The gate started from SFT step 400.

Load the adapter on Qwen/Qwen3.5-9B-Base revision 68c46c4b3498877f3ef123c856ecfde50c39f404. The SFT dataset was open-thoughts/OpenThoughts3-1.2M revision 61bcf9d4eb38b30295efc2021227a63cc5bb34c8; 384,000 examples were selected by deterministic streaming shuffle (seed 0, buffer 384,000). Training used LoRA rank 128, alpha 1, global batch 128, 16,384-token sequence length, learning rate 1e-3 with a linear schedule, and eight H100 GPUs. The pinned Axolotl fork source was d5ae94ae7446d3f3fc4ebc8d97fd9d00319f9811.

There was no AIME evaluation of step 2888. The most recent evaluated SFT checkpoint was step 2800, which scored 18/30 on our one-sample AIME 2024 test, including one length truncation. Do not attribute that score to these weights. Exact training configuration, run manifest, and checkpoint inventory are in the experiment's tinker-repro artifact bundle.

SHA-256 of the published fused files: adapter_model.safetensors = 5e3df847c0ba49f3b7935e8bd703fde0f54c36bfe98f32544a91254fc9a5d527; adapter_config.json = ab604790f400d65bc8f53a221de417c5c559d68031184a82f49e380d5362b131. The original raw Axolotl adapter had weight hash 93290bd17f927c7bf6904c9985f07f489d87cd8e7a0fa6602aef725434d41073 and config hash 4cf82fc9c3b92b8b60617dd9202fc4dd3e1eebb4492362a8418234913af94530; the source files remain in the original committed object-store checkpoint.

We release our tools to the public with the intent that they are used safely, ethically, and responsibly. They are meant to contribute to the public's understanding of science, and aid in its advancement. By using this Marin model, you agree to comply with all applicable law.