Downloads · 30 days
44
8% of all-time downloads
qwen3.5-4b-swe-opd-baseline-simple-step35
StephYang/qwen3.5-4b-swe-opd-baseline-simple-step35
qwen3.5-4b-swe-opd-baseline-simple-step35 is a text generation model from StephYang. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
On-policy distillation (OPD) checkpoint of Qwen3.5-4B (text) after 1 epoch / 35 steps on the tmax15k Harbor SWE set.
All-time downloads
550
Public
Parameters
4.2B
8.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen3_5_text
- Access
- Public
- Created
- Sep 7, 2026
- Updated
- Sep 7, 2026
- SHA
- 8ed15be4
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3.5-4B SWE-OPD baseline-simple (step 35)
On-policy distillation (OPD) checkpoint of Qwen3.5-4B (text) after 1 epoch / 35 steps on the tmax15k Harbor SWE set.
This is the merged Hugging Face export of the FSDP actor checkpoint:
swe_opd_baseline_simple / baseline_simple_1ep_bs12_lr5e7 / global_step_35
Training
| Item | Value |
|---|---|
| Base model | Qwen3.5-4B text (Qwen3_5ForCausalLM) |
| Method | On-policy distillation (OPD) |
| Dataset | tmax15k_top500_harbor_index30 |
| Steps | 35 (1 epoch) |
| Train batch size | 12 |
| Actor LR | 5e-7 |
| Max response length | 8192 |
| Distillation top-k | 8 |
| Student parallel | 12 GPU FSDP, DP=12 |
| Teacher | tmax-9b |
| Teacher probe / eval-turn mask | off (baseline-simple) |
Files
Merged from 12 FSDP shards (model_world_size_12_rank_*.pt) to a single bfloat16 model.safetensors.
Usage
Requires transformers>=5.6.0.
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "StephYang/qwen3.5-4b-swe-opd-baseline-simple-step35"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, dtype="bfloat16", device_map="auto")
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3_5_text
- License
- apache-2.0
- Created
- Sep 7, 2026
- Updated
- Sep 7, 2026