Downloads · 30 days
119
6% of all-time downloads
XformAI-india/Qwen3-0.6B-medicaldataset-gguf
Qwen3-0.6B-medicaldataset-gguf is a machine learning model from XformAI-india. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
A quantized GGUF-format version of Qwen3-0.6B, fine-tuned on a medical dataset to assist with healthcare-related tasks. Packaged in GGUF format for use with efficient inference engines like llama.cpp. Released by Xfor…
Downloads · 30 days
119
6% of all-time downloads
All-time downloads
2.1K
Public
Repo size
6.1 GB
Likes
1
Public
Click a slice to open those files.
.gguf6.1 GB · 100%
From the Hugging Face model README
A quantized GGUF-format version of Qwen3-0.6B, fine-tuned on a medical dataset to assist with healthcare-related tasks. Packaged in GGUF format for use with efficient inference engines like llama.cpp. Released by XformAI-India.
This quantized model is intended for:
⚠️ This model is not intended for clinical use.
Run with llama.cpp:
./main -m qwen3-0.6b-medical-q4_k_m.gguf -p "Explain symptoms of hypertension."
Or from Python using llama-cpp-python:
from llama_cpp import Llama
llm = Llama(model_path="qwen3-0.6b-medical-q4_k_m.gguf")
output = llm("What are treatment options for Type 2 Diabetes?", max_tokens=200)
print(output)
If you use this model, please cite:
@misc{qwen3medicalgguf2025,
title={Qwen3-0.6B-MedicalDataset-GGUF: A Quantized Medical AI Model},
author={XformAI-India},
year={2025},
url={https://huggingface.co/XformAI-india/Qwen3-0.6B-medicaldataset-gguf}
}