Downloads · 30 days
11
20% of all-time downloads
skyrl-tinker-qwen3-8b-tool_use
arvindcr4/skyrl-tinker-qwen3-8b-tool_use
skyrl-tinker-qwen3-8b-tool_use is a machine learning model from arvindcr4. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
LoRA fine-tuned with GRPO via SkyRL + Tinker.
All-time downloads
55
Public
Repo size
369 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors369 MB · 100%
At a glance
- Library
- peft
- License
- apache-2.0
- Access
- Public
- Created
- Mar 29, 2026
- Updated
- Mar 29, 2026
- SHA
- 7594c976
Base models
Model card
From the Hugging Face model README
skyrl-tinker-qwen3-8b-tool_use
LoRA fine-tuned with GRPO via SkyRL + Tinker.
Training Details
| Parameter | Value |
|---|---|
| Base model | Qwen/Qwen3-8B |
| Method | GRPO (Group Relative Policy Optimization) |
| Environment | tool_use |
| LoRA rank | 32 |
| Learning rate | 3e-05 |
| Steps | 2 |
| Group size | 8 |
| Final avg reward | 0.902 |
| Tinker run ID | eab60069-db43-5f60-bc58-4164bf576056:train:0 |
| W&B | https://wandb.ai/arvindcr4-pes-university/skyrl-tinker/runs/68h67x6y |
Usage
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-8B")
model = PeftModel.from_pretrained(base, "arvindcr4/skyrl-tinker-qwen3-8b-tool_use")
tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen3-8B")
Training Curve
Trained for 2 steps with final average reward of 0.902.
Framework
- RL Framework: SkyRL
- Training Backend: Tinker (hosted)
- Algorithm: GRPO
- Library
- peft
- License
- apache-2.0
- Created
- Mar 29, 2026
- Updated
- Mar 29, 2026