Downloads · 30 days
30
13% of all-time downloads
costinstroie/smollm2-135m-clinical-note-GGUF
smollm2-135m-clinical-note-GGUF is a text generation model from costinstroie. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
GGUF conversion of fahmiaziz/SmolLM2-135M-Instruct-Clinical-Note, an SFT (TRL) fine-tune of HuggingFaceTB/SmolLM2-135M-Instruct for clinical notes. Converted with llama.cpp (b8733); all credit for the fine-tune goes t…
Downloads · 30 days
30
13% of all-time downloads
All-time downloads
229
Public
Repo size
250 MB
Likes
1
Public
Click a slice to open those files.
.gguf250 MB · 100%
From the Hugging Face model README
GGUF conversion of fahmiaziz/SmolLM2-135M-Instruct-Clinical-Note, an SFT (TRL) fine-tune of HuggingFaceTB/SmolLM2-135M-Instruct for clinical notes. Converted with llama.cpp (b8733); all credit for the fine-tune goes to the original author.
| File | Size |
|---|---|
smollm2-135m-clinical-note-Q8_0.gguf | 139 MB |
smollm2-135m-clinical-note-Q4_K_M.gguf | 101 MB |
The embedded chat template is the ChatML template from the source repo.
llama-cli -m smollm2-135m-clinical-note-Q8_0.gguf
___ de-identification placeholders, which suggests training on de-identified hospital notes. This is expected of a 135M-parameter model and is not caused by quantization.Apache-2.0, inherited from the SmolLM2 base model. The source fine-tune does not state its own license or training data; verify with the original author before commercial use.