HaiJava-Surgeon-Qwen2.5-Coder-7B-SFT-v1

HaiJava-Surgeon-Qwen2.5-Coder-7B-SFT-v1

Model Name: HaiJava-Surgeon-Qwen2.5-Coder-7B-SFT-v1 Model Type: Supervised Fine-Tuned (SFT) - Merged LoRA + Base Model Base Model: Qwen/Qwen2.5-Coder-7B-Instruct Fine-tuning: checkpoint-1000 (1000 training steps on Java bug-fixing) Version: v1.0 Release Date: 2026-01-02 Status: ✅ Ready for Production / Further Training

---

📊 Model Performance

This model is the result of merging checkpoint-1000 (LoRA adapter) into the base Qwen2.5-Coder-7B-Instruct model.

MultiPL-E Java Benchmark Results

Key Achievements:

• ✅ +23 problems solved compared to base model
• ✅ 27 problems where SFT passes but base fails
• ✅ 103 problems where both models pass

Benchmark Details:

• Dataset: MultiPL-E Java (158 programming problems translated from HumanEval)
• Evaluation Date: 2026-01-08
• Temperature: 0.0 (deterministic)
• Max Tokens: 1024

Internal Evaluation Results (50-sample test set)

Statistical Significance: p-value = 0.0238* (significant at α=0.05)

---

🎯 Use Cases

1. Further Training

Use this merged model as the base for continued fine-tuning:

# LLaMA-Factory training config
model_name_or_path: ./HaiJava-Surgeon-Qwen2.5-Coder-7B-SFT-v1
finetuning_type: lora  # Can apply new LoRA on top
lora_target: q_proj,v_proj

Benefits:

• Start from improved baseline (28% accuracy vs 18%)
• No adapter overhead during training
• Can apply new LoRA adapters for specialized tasks

2. Direct Inference

Use for production inference without adapter loading:

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained(
    "./HaiJava-Surgeon-Qwen2.5-Coder-7B-SFT-v1",
    torch_dtype=torch.float16,
    device_map="auto"
)
tokenizer = AutoTokenizer.from_pretrained("./HaiJava-Surgeon-Qwen2.5-Coder-7B-SFT-v1")

# No adapter loading needed!

Benefits:

• Faster loading (no adapter merge at runtime)
• Simpler deployment (single model, no adapter files)
• Same performance as base + adapter

3. Production Deployment

Deploy directly to production environments:

# Copy to deployment server
scp -r HaiJava-Surgeon-Qwen2.5-Coder-7B-SFT-v1 user@server:/models/

# Use in production
python inference_server.py --model /models/HaiJava-Surgeon-Qwen2.5-Coder-7B-SFT-v1

---

📁 Model Files

Total Size: ~14GB

---

🔧 Training Details

Original LoRA Training (checkpoint-1000)

• Training Steps: 1000
• LoRA Rank (r): 16
• LoRA Alpha: 32
• Target Modules: q_proj, v_proj
• Dropout: 0.05
• Training Data: Java bug-fixing samples

Merge Process

• Method: merge_and_unload() from PEFT library
• Precision: float16
• Merge Date: 2026-01-02
• Verification: Passed (model loads successfully)

---

🚀 Quick Start

Load for Inference

import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

# Load model
model = AutoModelForCausalLM.from_pretrained(
    "./HaiJava-Surgeon-Qwen2.5-Coder-7B-SFT-v1",
    torch_dtype=torch.float16,
    device_map="auto",
    trust_remote_code=True
)

# Load tokenizer
tokenizer = AutoTokenizer.from_pretrained(
    "./HaiJava-Surgeon-Qwen2.5-Coder-7B-SFT-v1",
    trust_remote_code=True
)

# Generate
prompt = "Fix the bug in this Java code: int x = 10"
messages = [{"role": "user", "content": prompt}]
text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer([text], return_tensors="pt").to(model.device)

outputs = model.generate(**inputs, max_new_tokens=512, do_sample=False)
response = tokenizer.decode(outputs[0][inputs.input_ids.shape[1]:], skip_special_tokens=True)
print(response)

Load for Further Training

from transformers import AutoModelForCausalLM, TrainingArguments
from peft import LoraConfig, get_peft_model

# Load merged model as base
base_model = AutoModelForCausalLM.from_pretrained(
    "./HaiJava-Surgeon-Qwen2.5-Coder-7B-SFT-v1",
    torch_dtype=torch.float16,
    device_map="auto"
)

# Apply new LoRA for specialized training
lora_config = LoraConfig(
    r=16,
    lora_alpha=32,
    target_modules=["q_proj", "v_proj", "k_proj", "o_proj"],  # Can expand targets
    lora_dropout=0.05,
    task_type="CAUSAL_LM"
)

model = get_peft_model(base_model, lora_config)

# Continue training...

---

📊 Comparison with Alternatives

---

⚠️ Known Limitations

Based on evaluation, this model still struggles with:

• API Misuse Detection (0% accuracy)
• Edge Case Handling (0% accuracy)
• Null Pointer Exception Fixes (0% accuracy)
• Python Bug Fixing (0% accuracy on OOD samples)

Recommendation: Continue training with more diverse samples focusing on these categories.

---

📚 Related Files

• Evaluation Report: ../local_inference/CHECKPOINT_COMPARISON_54_vs_1000.md
• Original LoRA Checkpoint: ../checkpoint-1000/
• Merge Script: ../merge_lora_to_base.py
• Evaluation Results: ../local_inference/evaluation_results_sequential_*.json

---

🔄 Version History

---

📝 License

Inherits license from base model: Qwen/Qwen2.5-Coder-7B-Instruct

---

🙏 Acknowledgments

• Base Model: Qwen Team (Alibaba Cloud)
• Fine-tuning Framework: LLaMA-Factory
• Evaluation Framework: Custom 50-sample test suite

---

For questions or issues, refer to the evaluation documentation in local_inference/