Downloads · 30 days
9
13% of all-time downloads
pngwn/system-one-qwen3.5-4b-scorer-smoke
system-one-qwen3.5-4b-scorer-smoke is a machine learning model from pngwn. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as cc-by-nc-4.0.
Scores each option of a typed question (yes/no, choice, score) in a single forward pass and softmaxes per question. No autoregressive generation; the output space is exactly the option set supplied by the caller.
Downloads · 30 days
9
13% of all-time downloads
All-time downloads
67
Public
Repo size
142 MB
Likes
0
Public
Click a slice to open those files.
.safetensors122 MB · 86%
From the Hugging Face model README
Scores each option of a typed question (yes/no, choice, score) in a single forward pass and softmaxes per question. No autoregressive generation; the output space is exactly the option set supplied by the caller.
Training code: system_one.py in this repository.
pngwn/system-one-decisions (train questions 12913, epochs 2)| task | n | accuracy | ECE | Brier |
|---|---|---|---|---|
| banking77 | 64 | 0.062 | 0.055 | 0.960 |
| ALL | 64 | 0.062 | 0.055 | 0.960 |
| task | n | accuracy | ECE | Brier |
|---|---|---|---|---|
| banking77 | 64 | 0.078 | 0.014 | 0.963 |
| ALL | 64 | 0.078 | 0.014 | 0.963 |