Downloads · 30 days
7
14% of all-time downloads
doctoria/doctoria-rally-ai
doctoria-rally-ai is a image-text-to-text model from doctoria. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
Fine-tuned medical Vision-Language Model for SahhaAI — offline, private wound-care & medical VQA for disconnected clinics in Morocco.
Downloads · 30 days
7
14% of all-time downloads
All-time downloads
51
Public
Parameters
256M
1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors1 GB · 100%
From the Hugging Face model README
Fine-tuned medical Vision-Language Model for SahhaAI — offline, private wound-care & medical VQA for disconnected clinics in Morocco.
HuggingFaceTB/SmolVLM-256M-Instruct (SmolVLM)finetune/BENCHMARK.md for base-vs-fine-tuned analysis.from transformers import AutoProcessor, AutoModelForImageTextToText
from PIL import Image
m = AutoModelForImageTextToText.from_pretrained("doctoria/doctoria-rally-ai")
p = AutoProcessor.from_pretrained("doctoria/doctoria-rally-ai")
msgs = [{"role":"user","content":[{"type":"image"},{"type":"text","text":"Assess this wound."}]}]
text = p.apply_chat_template(msgs, add_generation_prompt=True)
inp = p(text=text, images=[[Image.open("wound.jpg")]], return_tensors="pt")
print(p.batch_decode(m.generate(**inp, max_new_tokens=128), skip_special_tokens=True)[0])
⚠ Decision support, not a diagnosis. A trained health worker stays in the loop.
— Author: Jad Tounsi El Azzouzi · part of SahhaAI · Apache-2.0