Downloads · 30 days
41
10% of all-time downloads
hmzBen/medgemma-1.5-medical-q4km
medgemma-1.5-medical-q4km is a text generation model from hmzBen. Use it when you need the model to write or continue text. It is set up for llama.cpp. The card lists the license as other.
This repository hosts a GGUF export of MedGemma-1.5-4B-IT, quantized for efficient local inference.
Downloads · 30 days
41
10% of all-time downloads
All-time downloads
392
Public
Repo size
10.3 GB
Likes
0
Public
Click a slice to open those files.
.gguf10.3 GB · 100%
From the Hugging Face model README
This repository hosts a GGUF export of MedGemma-1.5-4B-IT, quantized for efficient local inference.
google/medgemma-1.5-4b-itllama.cpp)Q4_K_M (mixed precision)medgemma-1.5-medical-Q4_K_M.gguf (quantized)medgemma-1.5-4b-it-F16.gguf (optional, full precision)./llama-server \
-m medgemma-1.5-medical-Q4_K_M.gguf \
--host 0.0.0.0 \
--port 8080 \
--alias medgemma
from medgemma_client import MedGemmaAgent
agent = MedGemmaAgent(base_url="http://localhost:8080")
print(agent.generate_clinical_text("Patient has stiff neck and fever. What is the triage concern?"))
This GGUF was produced using an I-Matrix calibrated on a medical mixed-domain dataset:
The goal is to preserve clinical reasoning while reducing memory footprint.
This model is not a substitute for professional medical advice. It can make mistakes and must be used with human oversight. Always validate outputs before use in clinical decision-making.
MedGemma is distributed under the Health AI Developer Foundations license by Google. Ensure your use and redistribution comply with the model terms: