Downloads · 30 days
9
25% of all-time downloads
ZhuofengLi/hardtests-sft-qwen3.5-27b-epoch1
hardtests-sft-qwen3.5-27b-epoch1 is a machine learning model from ZhuofengLi. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
LoRA adapter from supervised fine-tuning of Qwen/Qwen3.5-27B on the ZhuofengLi/hardtests-sft-qwen3.5-27b dataset (reward=1 competitive-programming trajectories with reasoning).
Downloads · 30 days
9
25% of all-time downloads
All-time downloads
36
Public
Repo size
117 MB
Likes
0
Public
Click a slice to open those files.
.safetensors117 MB · 100%
From the Hugging Face model README
LoRA adapter from supervised fine-tuning of Qwen/Qwen3.5-27B on the
ZhuofengLi/hardtests-sft-qwen3.5-27b
dataset (reward=1 competitive-programming trajectories with reasoning).
adapter_config.json)from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3.5-27B", torch_dtype="bfloat16", device_map="auto")
model = PeftModel.from_pretrained(base, "ZhuofengLi/hardtests-sft-qwen3.5-27b-epoch1")
model = model.merge_and_unload()
model.save_pretrained("./qwen3.5-27b-hardtests-sft-epoch1-merged")
AutoTokenizer.from_pretrained("Qwen/Qwen3.5-27B").save_pretrained("./qwen3.5-27b-hardtests-sft-epoch1-merged")