Downloads · 30 days
0
syvb/nla-qwen2.5-7b-L20-v3-rl-checkpoints
nla-qwen2.5-7b-L20-v3-rl-checkpoints is a machine learning model from syvb. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Full actor DCP (+optimizer state) and critic HF export from the v3 truncation-RL run (KL 0.03, uniform token truncation ~U[1,120], bullets prompt). To resume: place actordcp/ at $RUNDIR/actor/iter0000200, critichf/ at…
Downloads · 30 days
0
Access
Public
Updated Jul 2, 2026
Repo size
56.6 GB
Likes
0
Public
Click a slice to open those files.
.distcp45.7 GB · 81%
From the Hugging Face model README
Full actor DCP (+optimizer state) and critic HF export from the v3 truncation-RL run (KL 0.03, uniform token truncation ~U[1,120], bullets prompt). To resume: place actor_dcp/ at $RUN_DIR/actor/iter_0000200, critic_hf/ at $RUN_DIR/critic/iter_0000200/hf, write '200' to $RUN_DIR/actor/latest_checkpointed_iteration.txt, run run_rl_v3.sh. Inference-ready per-iter models live in syvb/nla-qwen2.5-7b-L20-v3-rl.