Downloads · 30 days
13
41% of all-time downloads
wckwan/arora-qwen3.5-9b-a0.1-seven-task
arora-qwen3.5-9b-a0.1-seven-task is a machine learning model from wckwan. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Qwen/Qwen3.5-9B trained with arorarloo (Arora & Zanette length-penalised RLOO, alpha = 0.1) on the seven-task setting: 100 steps, 32 prompts x 8 rollouts per step, lr 2e-6, KL 1e-3, 32K rollout cap, verl v0.9.1 (FSDP2…
Downloads · 30 days
13
41% of all-time downloads
All-time downloads
32
Public
Parameters
9.4B
37.7 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors37.6 GB · 100%
From the Hugging Face model README
Qwen/Qwen3.5-9B trained with arora_rloo (Arora & Zanette length-penalised RLOO, alpha = 0.1) on the seven-task setting: 100 steps, 32 prompts x 8 rollouts per step, lr 2e-6, KL 1e-3, 32K rollout cap, verl v0.9.1 (FSDP2 + vLLM). Training data: 512 examples (seed 0) from the official training splits; system prompt "Solve the user's task and give the final answer directly."; reward = task correctness of the text after </think>.