Downloads · 30 days
240
94% of all-time downloads
gpt-oss-20b-singprobe
inclusionAI/gpt-oss-20b-singprobe
gpt-oss-20b-singprobe is a machine learning model from inclusionAI. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
SingProbe is an intrinsic streaming guardrail built on openai/gpt-oss-20b. Rather than running a separate safety model, this lightweight probe reuses the base model's hidden states during generation to score, at every…
All-time downloads
255
Public
Parameters
5.8M
11.6 MB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors11.6 MB · 100%
At a glance
- License
- apache-2.0
- Model type
- sing_probe_attn
- Access
- Public
- Created
- Sep 14, 2026
- Updated
- Sep 14, 2026
- SHA
- a4112d68
Base models
Model card
From the Hugging Face model README
gpt-oss-20b-singprobe
Model Description
SingProbe is an intrinsic streaming guardrail built on openai/gpt-oss-20b. Rather than running a separate safety model, this lightweight probe reuses the base model's hidden states during generation to score, at every token, query intent, response unsafety, and hallucination risk. It adds less than 0.5% decode-time overhead.
| Base model | Probe parameters | Tapped layers | Outputs |
|---|---|---|---|
inclusionAI/gpt-oss-20b-singprobe | 5.8M | [6, 14, 22] | 8 intents + unsafe + hallucination |
See the technical report for methodology and complete results. Training codes are available at inclusionAI/SingProbe.
Evaluation
Higher is better for every metric. Results are averages over the benchmark suites specified below.
| Task | Metric | gpt-oss-20b-singprobe | Reference baseline |
|---|---|---|---|
| Query intent classification (6 benchmarks) | F1 | 0.8685 | YuFeng-XGuard-Reason-8B: 0.8714 |
| Response safety classification (8 benchmarks) | F1 | 0.8644 | Qwen3Guard-Gen-8B-strict: 0.8604 |
| Streaming safety (3 benchmarks) | R-AUC / T-AUC | 0.9781 / 0.9338 | Qwen3Guard-Stream-8B-strict: 0.9640 / 0.8893 |
| Hallucination detection (6 benchmarks) | AUC | 0.7581 | DRIFT: 0.8000 |
| Deployment characteristic | Result |
|---|---|
| Benign-response false-positive rate | 0.05% average across 5 datasets |
| Decode overhead | < 0.5% |
Quick Start
SingProbe is supported through the SGLang integration branch or vLLM integration branch. Load the probe by its Hugging Face ID at server launch:
python -m sglang.launch_server \
--model-path openai/gpt-oss-20b \
--probe-ckpt inclusionAI/gpt-oss-20b-singprobe \
--port 30000
The integrations return one score dictionary per generated token (label_0–label_9). Use the exact base-model/probe pair: openai/gpt-oss-20b with this checkpoint.
Citation
@article{singteam2026singprobe,
title = {SingProbe Technical Report},
author = {Sing Team},
journal = {arXiv preprint arXiv:2608.30703},
year = {2026},
}
- Type
- sing_probe_attn
- License
- apache-2.0
- Created
- Sep 14, 2026
- Updated
- Sep 14, 2026