Downloads · 30 days
0
gpt-oss-20b-4bit-grpo
zary0/gpt-oss-20b-4bit-grpo
gpt-oss-20b-4bit-grpo is a machine learning model from zary0. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
Access
Public
Updated Aug 13, 2025
Repo size
43.8 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json27.9 MB · 64%
At a glance
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- Aug 13, 2025
- Updated
- Aug 13, 2025
- SHA
- 735c4b87
Base models
Model card
From the Hugging Face model README
Overview
gpt-oss-12b-4bit — Unsloth LoRA Adapter
Training
Unsloth + QLoRA (4‑bit) + TRL GRPO (reinforcement learning)
QuickStart
messages = [
{"role": "system", "content": "reasoning language: French\n\nYou are a helpful assistant that can solve mathematical problems."},
{"role": "user", "content": "Solve x^5 + 3x^4 - 10 = 3."},
]
inputs = tokenizer.apply_chat_template(
messages,
add_generation_prompt = True,
return_tensors = "pt",
return_dict = True,
reasoning_effort = "medium",
).to(model.device)
from transformers import TextStreamer
_ = model.generate(**inputs, max_new_tokens = 2048, streamer = TextStreamer(tokenizer))
Acknowledgements
gpt‑oss authors and maintainers
Unsloth / PEFT / TRL / Transformers / Datasets communities
Contact
Author: Ryota Ozawa (zawatti)
X (Twitter): zawattizawawa
- Library
- transformers
- License
- apache-2.0
- Languages
- en
- Created
- Aug 13, 2025
- Updated
- Aug 13, 2025