Downloads · 30 days
16
10% of all-time downloads
llama3-medical-3b-4bit
Pablo305/llama3-medical-3b-4bit
llama3-medical-3b-4bit is a text generation model from Pablo305. Use it when you need the model to write or continue text. The card lists the license as llama3.2.
Llama 3.2 3B Instruct fine-tuned for first-aid question answering, quantized to 4-bit with bitsandbytes. I built this as the model component of kit-ai, an offline-first emergency first-aid PWA.
All-time downloads
155
Public
Parameters
3.3B
2.3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.2 GB · 99%
Parameter types
How the weights are stored.
U82.9B · 88%
Try a prompt
Base models
Model card
From the Hugging Face model README
llama3-medical-3b-4bit
Llama 3.2 3B Instruct fine-tuned for first-aid question answering, quantized to 4-bit with bitsandbytes. I built this as the model component of kit-ai, an offline-first emergency first-aid PWA.
Training
- Base model: meta-llama/Llama-3.2-3B-Instruct
- Method: [FILL IN: LoRA/QLoRA? framework? rough training setup]
- Data: [FILL IN: what the fine-tuning data was and how you built it]
- Quantization: 4-bit via bitsandbytes
Try it
The model runs in the offline-medical-assistant Space.
Limitations
This is not a medical device. It must not be used for diagnosis or treatment decisions, and in an emergency you should call your local emergency number. Outputs can be wrong or incomplete. The kit-ai app grounds its answers in a vetted first-aid knowledge base rather than trusting model output alone.
Evaluation
No formal evaluation yet. An eval harness comparing model answers against the vetted first-aid guidelines used by kit-ai is planned.
- Task
- Text Generation
- Type
- llama
- License
- llama3.2
- Languages
- en
- Created
- Feb 8, 2026
- Updated
- Jul 3, 2026