Downloads · 30 days
18
32% of all-time downloads
ZhuofengLi/hardtests-sft-qwen3.5-27b-r16-epoch2
hardtests-sft-qwen3.5-27b-r16-epoch2 is a machine learning model from ZhuofengLi. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
LoRA adapter from supervised fine-tuning of Qwen/Qwen3.5-27B on the ZhuofengLi/hardtests-sft-qwen3.5-27b dataset (reward=1 competitive-programming trajectories with reasoning).
Downloads · 30 days
18
32% of all-time downloads
All-time downloads
56
Public
Repo size
234 MB
Likes
0
Public
Click a slice to open those files.
.safetensors234 MB · 100%
From the Hugging Face model README
LoRA adapter from supervised fine-tuning of Qwen/Qwen3.5-27B on the
ZhuofengLi/hardtests-sft-qwen3.5-27b
dataset (reward=1 competitive-programming trajectories with reasoning).
adapter_config.json)from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3.5-27B", torch_dtype="bfloat16", device_map="auto")
model = PeftModel.from_pretrained(base, "ZhuofengLi/hardtests-sft-qwen3.5-27b-r16-epoch2")
model = model.merge_and_unload()
model.save_pretrained("./qwen3.5-27b-hardtests-sft-epoch2-merged")
AutoTokenizer.from_pretrained("Qwen/Qwen3.5-27B").save_pretrained("./qwen3.5-27b-hardtests-sft-epoch2-merged")