Downloads · 30 days
16
8% of all-time downloads
pathos-gemma4-distilled-GGUF
dhairyapandya/pathos-gemma4-distilled-GGUF
pathos-gemma4-distilled-GGUF is a machine learning model from dhairyapandya. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-4.0.
AI pathologist that runs offline on any laptop via Ollama.
All-time downloads
205
Public
Repo size
5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf5 GB · 100%
At a glance
- License
- cc-by-4.0
- Access
- Public
- Created
- May 17, 2026
- Updated
- Aug 24, 2026
- SHA
- 0522f0d4
Base models
Model card
From the Hugging Face model README
PathOS — Distilled GGUF for Ollama
AI pathologist that runs offline on any laptop via Ollama.
Quick Start
# 1. Download pathos-Q8_0.gguf and Modelfile from this repo
# 2. Place both files in the same folder, then:
ollama create pathos -f Modelfile
ollama run pathos "Is malignancy present?"
Model Details
| Property | Value |
|---|---|
| Base model | Gemma 4 E2B (2.6B params) |
| Training | SFT + GRPO distillation |
| Quantization | Q8_0 |
| Source | dhairyapandya/pathos-gemma4-distilled-rl-histopathology |
Distilled Techniques
All 6 inference-time techniques baked into the weights:
- Constrained decoding — always produces
<answer>tags - Anti-hedging — never says "cannot determine"
- Static RAG — few-shot exemplars in system prompt
- CoT routing — adapts reasoning to question type
- Per-type templates — YN/tissue/open formats
- Format compliance — GRPO reward shaping
- License
- cc-by-4.0
- Languages
- en
- Created
- May 17, 2026
- Updated
- Aug 24, 2026