Downloads · 30 days
0
katsukiono/qwen3-4b-medmcqa-klmvd-lora
qwen3-4b-medmcqa-klmvd-lora is a text generation model from katsukiono. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Adapter type: LoRA (PEFT) Base model: Qwen/Qwen3-4B Task: Medical multiple-choice reasoning (MedMCQA → KD/Distill, Bench=MedQA)
Downloads · 30 days
0
Access
Public
Updated Nov 8, 2025
Repo size
413 MB
Likes
0
Public
Click a slice to open those files.
.safetensors401 MB · 76%
From the Hugging Face model README
Adapter type: LoRA (PEFT)
Base model: Qwen/Qwen3-4B
Task: Medical multiple-choice reasoning (MedMCQA → KD/Distill, Bench=MedQA)
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
base_id = "Qwen/Qwen3-4B"
adapter_id = "katsukiono/qwen3-4b-medmcqa-klmvd-lora"
tok = AutoTokenizer.from_pretrained(base_id, use_fast=True)
base = AutoModelForCausalLM.from_pretrained(base_id, trust_remote_code=True, dtype="auto", device_map="auto")
model = PeftModel.from_pretrained(base, adapter_id)
# generate
prompt = "Question:\nA 65-year-old woman ...\nOptions:\nA. ...\nB. ...\nC. ...\nD. ...\nAnswer:"
out = model.generate(**tok(prompt, return_tensors="pt").to(model.device), max_new_tokens=64)
print(tok.decode(out[0], skip_special_tokens=True))
o_proj, up_proj, gate_proj, down_proj