Downloads · 30 days
3
10% of all-time downloads
Qwen3-4B-Instruct_rl_64_32_nokl_noentropy
haoranli-ml/Qwen3-4B-Instruct_rl_64_32_nokl_noentropy
Qwen3-4B-Instruct_rl_64_32_nokl_noentropy is a machine learning model from haoranli-ml. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
31
Public
Parameters
4.4B
8.8 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8.8 GB · 100%
At a glance
- Model type
- qwen3
- Access
- Public
- Created
- Nov 24, 2025
- Updated
- Nov 24, 2025
- SHA
- 4957e1db
Model card
From the Hugging Face model README
nnodes=2
n_gpus_per_node=4
train_batch_size=64
ppo_mini_batch_size=32
rollout_n=8
learning_rate=1e-6
kl_loss_coef=0
entropy_coeff=0
temperature=0.8
clip_ratio_low=0.2
clip_ratio_high=0.26
epoch=10
# below is settings for Dr.GRPO
loss_agg_mode="seq-mean-token-sum-norm"
use_kl_loss=False
norm_adv_by_std_in_grpo=False
- Type
- qwen3
- Created
- Nov 24, 2025
- Updated
- Nov 24, 2025