Downloads · 30 days
11
5% of all-time downloads
xw1234gan/seccodeplt-qwen2.5-coder-3b-grpo-no-kl-real-reward-v2
seccodeplt-qwen2.5-coder-3b-grpo-no-kl-real-reward-v2 is a text generation model from xw1234gan. Use it when you need the model to write or continue text. It is set up for transformers.
GRPO without KL regularization for the SecCodePLT+ compliance experiment using Qwen/Qwen2.5-Coder-3B-Instruct. This v2 run corrects causal-label alignment and uses the official ReaL safety-unit-test reward with DAPO-s…
Downloads · 30 days
11
5% of all-time downloads
All-time downloads
231
Public
Parameters
3.1B
6.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors6.2 GB · 100%
From the Hugging Face model README
GRPO without KL regularization for the SecCodePLT+ compliance experiment using
Qwen/Qwen2.5-Coder-3B-Instruct. This v2 run corrects causal-label alignment and uses the
official ReaL safety-unit-test reward with DAPO-style token loss and dynamic
sampling. Training used seed 42 and the official 655-example training split.
Evaluation used greedy decoding on all 164 official test examples.
| Metric | Value |
|---|---|
| Mean reward | 0.396741 |
| Output format pass | 96.95% |
| Syntax pass | 96.95% |
| Capability pass | 23.78% |
| Safety pass | 56.71% |
| Joint pass | 15.24% |
This is a single-seed research checkpoint evaluated with the benchmark's resource-bounded Python verifier. It is not a general guarantee of secure code.