Downloads · 30 days
7
19% of all-time downloads
qwen3-4b-tau2-telecom_2_setting4_n74-1ep
MANGSEOK123/qwen3-4b-tau2-telecom_2_setting4_n74-1ep
qwen3-4b-tau2-telecom_2_setting4_n74-1ep is a machine learning model from MANGSEOK123. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Qwen3-4B-Instruct-2507 consolidated with OEL on the tau2-bench telecom domain, using 72 task–memory pairs.
All-time downloads
36
Public
Parameters
4.4B
8.8 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8.8 GB · 100%
At a glance
- License
- apache-2.0
- Model type
- qwen3
- Access
- Public
- Created
- Sep 24, 2026
- Updated
- Sep 24, 2026
- SHA
- 8a32777c
Base models
Model card
From the Hugging Face model README
Qwen3-4B-Instruct-2507 — tau2-bench telecom
Qwen3-4B-Instruct-2507 consolidated with OEL on the tau2-bench telecom domain, using 72 task–memory pairs.
Training
| base model | Qwen3-4B-Instruct-2507 |
| training pairs | 72 |
| batch size | 6 |
| epochs | 1 |
| learning rate | 3e-6, constant |
| gradient clipping | 1.0 (verl default) |
| loss | full KL over all response tokens, kl_topk 256 |
| user simulator | gpt-4.1-mini (temperature 0) |
The student replays each task without memory; the teacher is the same weights with that task's memory in the system prompt. Only the prompt differs, and no reward is used.
| step | KL loss | entropy | grad norm |
|---|---|---|---|
| 1 | 0.032 | 0.079 | 13.128 |
| 2 | 0.028 | 0.108 | 8.678 |
| 3 | 0.013 | 0.513 | 1.865 |
| 4 | 0.012 | 0.502 | 0.970 |
| 5 | 0.010 | 0.360 | 0.749 |
| 6 | 0.017 | 0.341 | 2.415 |
| 7 | 0.045 | 0.140 | 8.076 |
| 8 | 0.090 | 0.108 | 6.857 |
| 9 | 0.060 | 0.112 | 5.150 |
| 10 | 0.017 | 0.506 | 8.958 |
| 11 | 0.017 | 0.323 | 2.048 |
| 12 | 0.016 | 0.453 | 1.190 |
Each step reads a different batch, so the loss column tracks batch difficulty rather than convergence.
Evaluation
Not evaluated. Pushed straight after training. For reference the base model scores
avg 0.056 / pass@4 0.175 on the tau2-bench telecom test split.
Usage
vllm serve MANGSEOK123/qwen3-4b-tau2-telecom_2_setting4_n74-1ep \
--enable-auto-tool-choice --tool-call-parser hermes --max-model-len 40960
- Type
- qwen3
- License
- apache-2.0
- Created
- Sep 24, 2026
- Updated
- Sep 24, 2026