Downloads · 30 days
43
9% of all-time downloads
docvm/medgemma-1.5-4b-it-GGUF
medgemma-1.5-4b-it-GGUF is a text generation model from docvm. Use it when you need the model to write or continue text. The card lists the license as other.
GGUF quantization of google/medgemma-1.5-4b-it for mobile/edge deployment.
Downloads · 30 days
43
9% of all-time downloads
All-time downloads
480
Public
Repo size
2.5 GB
Likes
1
Public
Click a slice to open those files.
.gguf2.5 GB · 100%
From the Hugging Face model README
GGUF quantization of google/medgemma-1.5-4b-it for mobile/edge deployment.
| File | Quant | Size | Use case |
|---|---|---|---|
medgemma-1.5-4b-it-Q4_K_M.gguf | Q4_K_M | ~2.5 GB | Mobile / edge devices |
llama-cli -m medgemma-1.5-4b-it-Q4_K_M.gguf -cnv
Create a Modelfile:
FROM ./medgemma-1.5-4b-it-Q4_K_M.gguf
Then:
ollama create medgemma -f Modelfile
ollama run medgemma
Use the Q4_K_M file (~2.5 GB fits in most modern phone RAM).
This model powers Sakhi, an AI clinical companion for ASHA workers in rural India, with 3 modes: