Downloads · 30 days
11
21% of all-time downloads
Qwen3-8B-Base-TauSFT-Tau
willhx/Qwen3-8B-Base-TauSFT-Tau
Qwen3-8B-Base-TauSFT-Tau is a reinforcement learning model from willhx. Use it for the reinforcement learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
RL checkpoint of Qwen3-8B-Base for tau-bench agentic tool-use, trained with slime (Megatron-LM training + SGLang rollout).
All-time downloads
53
Public
Parameters
8.2B
16.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors16.4 GB · 100%
At a glance
- Task
- Reinforcement Learning
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen3
- Access
- Public
- Created
- Jul 13, 2026
- Updated
- Jul 13, 2026
- SHA
- d9b12ba3
Base models
Model card
From the Hugging Face model README
Qwen3-8B-Base-TauSFT-Tau
RL checkpoint of Qwen3-8B-Base for tau-bench agentic tool-use, trained with
slime (Megatron-LM training + SGLang rollout).
Pipeline: Qwen3-8B-Base → SFT on tau-bench trajectories (TauSFT) → RL on tau-bench (Tau).
This is the checkpoint at iteration 180, converted from Megatron torch_dist format to
Hugging Face safetensors (bf16).
Training setup
| Base model | Qwen/Qwen3-8B-Base |
| Framework | slime (Megatron-LM + SGLang) |
| Task | tau-bench (tool-use dialogues) |
| User simulator | zai-org/GLM-4.7-Flash via an OpenAI-compatible endpoint |
| Precision | bfloat16 |
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model_name = "willhx/Qwen3-8B-Base-TauSFT-Tau"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name, torch_dtype="bfloat16", device_map="auto")
The model is trained to emit tool calls in the tau-bench format; evaluate it inside a tau-bench environment rather than as a general-purpose chat model.
Notes
This is an intermediate RL checkpoint released for research purposes. It has not been safety-tuned, and it inherits the license and limitations of the underlying Qwen3-8B-Base model.
- Task
- Reinforcement Learning
- Library
- transformers
- Type
- qwen3
- License
- apache-2.0
- Created
- Jul 13, 2026
- Updated
- Jul 13, 2026