Downloads · 30 days
20
6% of all-time downloads
billylo/medgemma-1.5-4b-it-mmproj-gguf
medgemma-1.5-4b-it-mmproj-gguf is a machine learning model from billylo. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Vision encoder (mmproj) for MedGemma 1.5 4B, converted to GGUF for use with llama.cpp and llama-mtmd-cli. Use this file together with a text GGUF of MedGemma 1.5 4B to run multimodal (image + text) inference.
Downloads · 30 days
20
6% of all-time downloads
All-time downloads
326
Public
Repo size
851 MB
Likes
1
Public
Click a slice to open those files.
.gguf851 MB · 100%
From the Hugging Face model README
Vision encoder (mmproj) for MedGemma 1.5 4B, converted to GGUF for use with llama.cpp and llama-mtmd-cli. Use this file together with a text GGUF of MedGemma 1.5 4B to run multimodal (image + text) inference.
convert_hf_to_gguf.py --mmproj from the Hugging Face model; no training or fine-tuning.llama-mtmd-cli binary (e.g. brew install llama.cpp on macOS).huggingface-cli download billylo/medgemma-1.5-4b-it-mmproj-gguf mmproj-medgemma-1.5-4b-it-BF16.gguf --local-dir ./mmproj
llama-mtmd-cli -m /path/to/medgemma-1.5-4b-it-text.gguf \
--mmproj mmproj-medgemma-1.5-4b-it-BF16.gguf \
--image page.png \
-p "Describe the findings in this medical report."
For apps that expect a single mmproj file next to the text model (e.g. named mmproj.gguf), copy or symlink this file accordingly.
Same as the base MedGemma model: research and education in medical/health AI. Not for direct clinical decision-making. See the MedGemma model card and Google Health AI documentation for limitations and terms.
If you use MedGemma, cite the MedGemma paper and the llama.cpp project as appropriate.