Downloads · 30 days
22
4% of all-time downloads
Ali-001-ch/sehatsaathi-gemma4-e4b-GGUF
sehatsaathi-gemma4-e4b-GGUF is a text generation model from Ali-001-ch. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Quantized GGUF builds of the SehatSaathi LoRA fine-tune of Gemma 4 E4B, for offline phone & laptop deployment via Ollama or llama.cpp.
Downloads · 30 days
22
4% of all-time downloads
All-time downloads
529
Public
Repo size
13.4 GB
Likes
0
Public
Click a slice to open those files.
.gguf13.4 GB · 100%
From the Hugging Face model README
Quantized GGUF builds of the SehatSaathi LoRA fine-tune of Gemma 4 E4B, for offline phone & laptop deployment via Ollama or llama.cpp.
Ali-001-ch/sehatsaathi-gemma4-e4bAli-001-ch/sehatsaathi-gemma4-e4b-loraunsloth/gemma-4-E4B-it| File | Quant | Size | Use case |
|---|---|---|---|
sehatsaathi-q4_k_m.gguf | Q4_K_M | ~5.5 GB | Phones, edge devices |
sehatsaathi-q8_0.gguf | Q8_0 | ~9 GB | Laptops, near-lossless |
ollama pull hf.co/Ali-001-ch/sehatsaathi-gemma4-e4b-GGUF:Q4_K_M
ollama run hf.co/Ali-001-ch/sehatsaathi-gemma4-e4b-GGUF:Q4_K_M
./llama-cli -m sehatsaathi-q4_k_m.gguf \
--temp 1.0 --top-p 0.95 --top-k 64 --color --conversation
SehatSaathi is a medical screening / triage assistant, NOT a substitute for a qualified doctor. In an emergency call 1122 (Pakistan Rescue). License: Apache-2.0 + Gemma Terms of Use.