110611065_DL_kaggle-2

110611065 DL Kaggle 2

This repository contains the epoch 2 LoRA adapter from the Kaggle #2 reasoning SFT run.

base model: Qwen/Qwen2.5-72B-Instruct
run: qwen25_72b_qlora_reasoning_sft_20260523_003801
checkpoint: checkpoint-764
training: QLoRA reasoning SFT

The adapter was trained locally for the NYCU deep learning Kaggle #2 multiple-choice reasoning task. It is intended to be loaded together with Qwen/Qwen2.5-72B-Instruct.

Load

from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
import torch

base = "Qwen/Qwen2.5-72B-Instruct"
adapter = "Atziluth98061/110611065_DL_kaggle-2"

tokenizer = AutoTokenizer.from_pretrained(base, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
    base,
    torch_dtype=torch.bfloat16,
    device_map="auto",
    trust_remote_code=True,
)
model = PeftModel.from_pretrained(model, adapter)
model.eval()

Files

adapter_model.safetensors
adapter_config.json
tokenizer.json
tokenizer_config.json
chat_template.jinja

Optimizer, scheduler, RNG, and trainer state files are intentionally omitted because they are not needed for inference.