Downloads · 30 days
16
12% of all-time downloads
costinstroie/medical-gemma-270m-GGUF
medical-gemma-270m-GGUF is a machine learning model from costinstroie. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for gguf. The card lists the license as gemma.
GGUF conversion of vervelo/medical-gemma-270m-mlx, a LoRA adapter (rank 16) for google/gemma-3-270m-it fine-tuned to turn medical dialogues into SOAP notes.
Downloads · 30 days
16
12% of all-time downloads
All-time downloads
135
Public
Repo size
545 MB
Likes
0
Public
Click a slice to open those files.
.gguf545 MB · 100%
From the Hugging Face model README
GGUF conversion of vervelo/medical-gemma-270m-mlx, a LoRA adapter (rank 16) for google/gemma-3-270m-it fine-tuned to turn medical dialogues into SOAP notes.
The MLX adapter was merged into the base weights (W + scale·(A·B)ᵀ, fp32, then stored as bf16) and converted with llama.cpp (b8733). All credit for the fine-tune goes to the original author; this repo only repackages it.
| File | Size |
|---|---|
medical-gemma-270m-Q8_0.gguf | 279 MB |
medical-gemma-270m-Q4_K_M.gguf | 242 MB |
The embedded chat template reproduces the training prompt: the user message is the dialogue, and an optional system message replaces the default instruction.
llama-cli -m medical-gemma-270m-Q8_0.gguf
# paste: Doctor: What brings you in? Patient: I have had a cough and fever for three days.
Raw-prompt equivalent:
### Instruction: Convert the following medical dialogue into a structured SOAP note (Subjective, Objective, Assessment, Plan).
### Input: Dialogue: <dialogue>
### Response: SOAP Note:
Q8_0 is recommended; at 270M parameters Q4_K_M loses noticeable quality.
Very small model; output is often terse. Trained on synthetic dialogues. Not for clinical use — outputs may be wrong and must be reviewed by a qualified professional.
Subject to the Gemma Terms of Use, inherited from the base model. Training data licenses: MTS-Dialog CC BY 4.0; MedSynth has no explicit license (research use).