Skip to content

lilyzhng

gpt-oss-20b-tb2-grpo-lora

lilyzhng/gpt-oss-20b-tb2-grpo-lora

gpt-oss-20b-tb2-grpo-lora is a machine learning model from lilyzhng. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.

LoRA after GRPO on Nemotron probe band (rewardmode=ctrfonly).

Downloads · 30 days

4

10% of all-time downloads

All-time downloads

42

Public

Repo size

63.7 MB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors63.7 MB · 100%

At a glance

Library
peft
Access
Public
Created
Jun 10, 2026
Updated
Jun 10, 2026
SHA
b8937311

Base models

Library
peft
Created
Jun 10, 2026
Updated
Jun 10, 2026