Skip to content

Occupying-Mars

qwen3-4b-symbolic-vanilla-ppo-v1

Occupying-Mars/qwen3-4b-symbolic-vanilla-ppo-v1

qwen3-4b-symbolic-vanilla-ppo-v1 is a reinforcement learning model from Occupying-Mars. Use it for the reinforcement learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.

Qwen/Qwen3-4B-Instruct-2507 trained with vanilla PPO (Schulman et al. 2017 — clipped surrogate, learned value head, trainer-side GAE) on the deterministic symbolic tool-calling benchmark from the GRPO-vs-PPO-under-rol…

Downloads · 30 days

8

14% of all-time downloads

All-time downloads

59

Public

Parameters

4B

8.1 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors8 GB · 100%

At a glance

Task
Reinforcement Learning
Library
transformers
License
apache-2.0
Model type
qwen3
Access
Public
Created
Jul 12, 2026
Updated
Jul 12, 2026
SHA
3af25c12

Base models

Task
Reinforcement Learning
Library
transformers
Type
qwen3
License
apache-2.0
Created
Jul 12, 2026
Updated
Jul 12, 2026