Downloads · 30 days
4
7% of all-time downloads
imdatta0/qwen3-4b-swegym-moto-hardmulti-sft20k-teachergap-v1-adapter
qwen3-4b-swegym-moto-hardmulti-sft20k-teachergap-v1-adapter is a text generation model from imdatta0. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.
This repository contains a PEFT LoRA adapter for unsloth/Qwen3-4B-Instruct-2507.
Downloads · 30 days
4
7% of all-time downloads
All-time downloads
54
Public
Repo size
144 MB
Likes
0
Public
Click a slice to open those files.
.safetensors132 MB · 92%
From the Hugging Face model README
This repository contains a PEFT LoRA adapter for unsloth/Qwen3-4B-Instruct-2507.
The adapter was trained as a bounded SFT continuation from the hard-multi 20k Qwen3-4B frontier adapter. The training mix preserved all 18 hard-multi rows and added 62 train-only teacher-gap rows selected from existing Coder-30B passing labels.
Held-out SWE-Gym Moto search/replace patch evaluation, 20k anchored retrieval context, bfloat16, sample seed 9012:
| adapter | context | seed | greedy | selected@1 | pass@8 | single pass@8 | multi pass@8 |
|---|---|---|---|---|---|---|---|
| hard-multi plus teacher-gap SFT | 20k | 9012 | 10/35 | 11/35 | 14/35 | 9/18 | 5/17 |
This was the first measured 4B checkpoint in this investigation with 5/17 multi-file pass@8 in a single seed, gaining moto-6641 versus the seed9012 hard-multi frontier. It is not promoted over the hard-multi frontier overall because overall pass@8 drops from 16/35 to 14/35.
adapter_model.safetensors: PEFT LoRA adapter weightsadapter_config.json: PEFT adapter configurationcheckpoint_metadata.json: local training metadataThe base model weights are not included.