Downloads · 30 days
75
18% of all-time downloads
uaritm/medgemma-4b-cardiology-gguf
medgemma-4b-cardiology-gguf is a machine learning model from uaritm. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for adapter-transformers. The card lists the license as apache-2.0.
Downloads · 30 days
75
18% of all-time downloads
All-time downloads
419
Public
Repo size
6.9 GB
Likes
2
Public
Click a slice to open those files.
.gguf6.9 GB · 100%
From the Hugging Face model README
MedGemma-4B-Cardiology is a domain-adapted medical language model built on
google/medgemma-4b-it and fine-tuned via supervised instruction tuning (SFT) on anonymized cardiology clinical data:
The model is optimized for:
GGUF format ensures compatibility with:
medgemma-4b-cardiology.Q4_K_M.gguf medgemma-4b-cardiology.Q5_K_M.gguf tokenizer.json README.md
./main -m medgemma-4b-cardiology.Q4_K_M.gguf
-p "You are a cardiologist. Based on the clinical details, generate treatment recommendations."
Create a file named Modelfile:
FROM ./medgemma-4b-cardiology.Q4_K_M.gguf TEMPLATE "<start_of_turn>user\n{{ .Prompt }}\n<end_of_turn>\n<start_of_turn>assistant" PARAMETER temperature 0.3
Then run:
ollama create medcardio -f Modelfile
ollama run medcardio
from llama_cpp import Llama
llm = Llama( model_path="medgemma-4b-cardiology.Q4_K_M.gguf", n_ctx=4096, n_gpu_layers=35, )
prompt = "You are a cardiologist. Patient: 67-year-old male with stable angina. Provide evidence-based recommendations."
output = llm(prompt, max_tokens=400) print(output["choices"][0]["text"])
The model expects chat-structured input:
<start_of_turn>user
[Your instruction or clinical text]
<end_of_turn>
<start_of_turn>assistant
Example:
<start_of_turn>user
You are a cardiologist. Generate recommendations for:
Sex: Male
Age: 67
Length of stay: 10 days
[discharge summary...]
<end_of_turn>
<start_of_turn>assistant
Training dataset included >12,000 cardiology-specific instruction-response pairs:
{ "prompt": "...", "response": "..." }
Converted into Gemma-style messages:
{ "messages": [ {"role": "user", "content": "..."}, {"role": "assistant", "content": "..."} ] }
Training setup:
This model is NOT a medical device and must not be used for autonomous diagnosis or treatment decisions.
Outputs require interpretation and verification by certified medical professionals.
Intended solely for research and decision-support augmentation.
If you use this model in your research, please cite:
@misc{Ostashko2025MedGemmaCardiology, title = {MedGemma-4B-Cardiology: A Domain-Finetuned Clinical LLM for Cardiology}, author = {Uaritm}, year = {2025}, url = {ai.esemi.org} }
Project homepage: https://ai.esemi.org
If you found this model useful — please give a star on HuggingFace: