Downloads · 30 days
18
12% of all-time downloads
thesreedath/slm-125m-qa
slm-125m-qa is a machine learning model from thesreedath. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
125M legal SLM, closed-book QA fine-tune of thesreedath/slm-125m-base. Answers questions from its own weights (no context passage), and refuses when it does not know. Trained on ~7.1k self-contained, faithfulness-judg…
Downloads · 30 days
18
12% of all-time downloads
All-time downloads
156
Public
Parameters
126M
252 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors252 MB · 100%
From the Hugging Face model README
125M legal SLM, closed-book QA fine-tune of thesreedath/slm-125m-base. Answers questions from its own weights (no context passage), and refuses when it does not know. Trained on ~7.1k self-contained, faithfulness-judged, decontaminated Q&A pairs (10% refusals). Loss on answer tokens only.
Chat template: <|bos|><|system|>\n{SYSTEM}<|eos|>\n<|user|>\n{QUESTION}<|eos|>\n<|assistant|>\n