Downloads · 30 days
11
18% of all-time downloads
jb10231/MedLLaMA-3.2-3B-LabReport
MedLLaMA-3.2-3B-LabReport is a machine learning model from jb10231. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as llama3.2.
This is a fine-tuned version of meta-llama/Llama-3.2-3B-Instruct trained on medical Q&A data to answer patient queries about lab reports and health conditions.
Downloads · 30 days
11
18% of all-time downloads
All-time downloads
62
Public
Repo size
115 MB
Likes
1
Public
Click a slice to open those files.
.safetensors97.3 MB · 85%
From the Hugging Face model README
This is a fine-tuned version of meta-llama/Llama-3.2-3B-Instruct trained on medical Q&A data to answer patient queries about lab reports and health conditions.
This model is for educational and informational purposes only. It is NOT a substitute for professional medical advice, diagnosis, or treatment. Always consult a qualified healthcare provider for medical decisions.
from transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfig
from peft import PeftModel
import torch
base_model = AutoModelForCausalLM.from_pretrained(
'meta-llama/Llama-3.2-3B-Instruct',
quantization_config=BitsAndBytesConfig(load_in_4bit=True),
device_map='auto'
)
model = PeftModel.from_pretrained(base_model, 'jb10231/MedLLaMA-3.2-3B-LabReport')
tokenizer = AutoTokenizer.from_pretrained('jb10231/MedLLaMA-3.2-3B-LabReport')