Downloads · 30 days
4
4% of all-time downloads
samandar1105/qwen-medical-qa-lora
qwen-medical-qa-lora is a question answering model from samandar1105. Use it when the input is a question plus a passage. It is set up for peft. The card lists the license as apache-2.0.
Fine-tuned with QLoRA on MedQuAD for generative medical question answering. Designed to be used as the generator in a RAG pipeline.
Downloads · 30 days
4
4% of all-time downloads
All-time downloads
104
Public
Repo size
431 MB
Likes
0
Public
Click a slice to open those files.
.safetensors120 MB · 91%
From the Hugging Face model README
Fine-tuned with QLoRA on MedQuAD for generative medical question answering. Designed to be used as the generator in a RAG pipeline.
Research/portfolio project. Not a certified medical device. Not a substitute for professional medical advice.
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-3B-Instruct", device_map="auto")
model = PeftModel.from_pretrained(base, "samandar1105/qwen-medical-qa-lora")
tokenizer = AutoTokenizer.from_pretrained("samandar1105/qwen-medical-qa-lora")