Downloads · 30 days
0
koreallmdev/qwen3-8b-operational-guardrail-v3
qwen3-8b-operational-guardrail-v3 is a text generation model from koreallmdev. Use it when you need the model to write or continue text. It is set up for peft.
This repository contains a PEFT LoRA adapter plus an operational guardrail wrapper.
Downloads · 30 days
0
Access
Public
Updated Jul 5, 2026
Repo size
186 MB
Likes
0
Public
Click a slice to open those files.
.safetensors175 MB · 94%
From the Hugging Face model README
This repository contains a PEFT LoRA adapter plus an operational guardrail wrapper.
This is not a standalone full base-model upload. The base model is Qwen/Qwen3-8B; this repository contains the LoRA adapter and operational guardrail code.
The measured operational result is based on:
current_candidate + guardrail_policy_v3 + guarded OpenAI-compatible proxy
It should not be interpreted as raw model-only performance.
adapter/
adapter_config.json
adapter_model.safetensors
guardrail/
guardrail_policy_v3.py
guarded_openai_proxy_v3.py
run_guarded_openai_chat_v3.py
reports/
benchmark and operational smoke reports
scripts/
upload_hf_operational_v3.py
Internal 10-question benchmark after guardrail:
average_score=94.5
pass70=10/10
strong85=10/10
fatal=0
The guardrail blocks or replaces responses when it detects:
CJK/Han leakage
raw internal reasoning tag leakage
repetition collapse
decision keyword gap for stable promotion decisions
For guarded deployment, use the proxy rather than sending clients directly to the raw vLLM endpoint.
raw vLLM:
http://localhost:8000/v1
guarded proxy:
http://127.0.0.1:8010/v1
Use PEFT with the base model, or serve with vLLM LoRA support. The adapter is stored under adapter/.