Downloads · 30 days
83
41% of all-time downloads
costinstroie/qwen2.5-1.5b-medical-sft-GGUF
qwen2.5-1.5b-medical-sft-GGUF is a machine learning model from costinstroie. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for gguf. The card lists the license as apache-2.0.
GGUF conversion of PrasannaPaithankar/qwen2.5-1.5b-medical-sft-lora, a Qwen2.5-1.5B model fine-tuned on medical data (full merged fp16 weights despite the "lora" in the name). Converted with llama.cpp (b8733); all cre…
Downloads · 30 days
83
41% of all-time downloads
All-time downloads
204
Public
Repo size
2.6 GB
Likes
0
Public
Click a slice to open those files.
.gguf2.6 GB · 100%
From the Hugging Face model README
GGUF conversion of PrasannaPaithankar/qwen2.5-1.5b-medical-sft-lora, a Qwen2.5-1.5B model fine-tuned on medical data (full merged fp16 weights despite the "lora" in the name). Converted with llama.cpp (b8733); all credit for the fine-tune goes to the original author.
| File | Size |
|---|---|
qwen2.5-1.5b-medical-sft-Q8_0.gguf | 1.6 GB |
qwen2.5-1.5b-medical-sft-Q4_K_M.gguf | 941 MB |
The embedded chat template is the standard Qwen ChatML template shipped with the source repo.
llama-cli -m qwen2.5-1.5b-medical-sft-Q8_0.gguf