Downloads · 30 days
33
14% of all-time downloads
Hemlock2-Coder-7B-GRPO
nbeerbower/Hemlock2-Coder-7B-GRPO
Hemlock2-Coder-7B-GRPO is a reinforcement learning model from nbeerbower. Use it for the reinforcement learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
hemlang/Hemlock2-Coder-7B improved with execution-reward GRPO (grimoire ≥ 2.0 / hemlock-rl). Completions were executed in the Hemlock interpreter's sandbox and rewarded for exactly reproducing verified reference stdout.
All-time downloads
240
Public
Parameters
7.6B
23.3 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors15.2 GB · 65%
At a glance
- Task
- Reinforcement Learning
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Jul 15, 2026
- Updated
- Jul 15, 2026
- SHA
- 13808029
Base models
Datasets
Model card
From the Hugging Face model README
Hemlock2-Coder-7B-GRPO
hemlang/Hemlock2-Coder-7B improved with execution-reward GRPO (grimoire ≥ 2.0 / hemlock-rl). Completions were executed in the Hemlock interpreter's sandbox and rewarded for exactly reproducing verified reference stdout.
Strictly improves the base model on hembench (zero-shot, n=5, benchmark-overlapping training tasks held out):
| pass@1 | pass@5 | |
|---|---|---|
| Hemlock2-Coder-7B | 28.9% | 55.3% |
| Hemlock2-Coder-7B-GRPO | 36.8% (+7.9) | 57.9% (+2.6) |
Largest gains in syntax (L1 pass@1 2/9 → 4/9, pass@5 7/9 → 8/9) and systems/concurrency (L4 pass@1 1/7 → 3/7).
Training
- Method: GRPO (LoRA r=16 α=32, β=0.1 KL vs frozen base, G=8, dynamic sampling, unscaled advantages), 186 deduplicated prompts × 3 epochs.
- Rewards: sandboxed execution; exact stdout match vs verified reference = 2.0, runs-but-wrong = 0.5, error = −0.5, no code / timeout = −1.0.
- Data: execution-verified translation/generation tasks (now published as hemlang/hemlock-codex3-SFT), one language-variant per task, hembench-name-overlapping tasks excluded.
Q8_0 GGUF included.
- Task
- Reinforcement Learning
- Type
- qwen2
- License
- apache-2.0
- Created
- Jul 15, 2026
- Updated
- Jul 15, 2026