Downloads · 30 days
12
12% of all-time downloads
osieosie/tmax-qwen3-8b-tmax-sft-full-20260513
tmax-qwen3-8b-tmax-sft-full-20260513 is a machine learning model from osieosie. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Supervised fine-tune of hamishivi/Qwen3-8B on osieosie/tmax-sft-full-20260513-bad-tool-call-filtered, mixing all 8 subsets at weight 1.0 each.
Downloads · 30 days
12
12% of all-time downloads
All-time downloads
97
Public
Parameters
8.2B
16.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors16.4 GB · 100%
From the Hugging Face model README
Supervised fine-tune of hamishivi/Qwen3-8B on osieosie/tmax-sft-full-20260513-bad-tool-call-filtered, mixing all 8 subsets at weight 1.0 each.
Dataset: osieosie/tmax-sft-full-20260513-bad-tool-call-filtered
Subsets:
`allenai__Sera_4.6_Lite_47000` (mixer weight `1.0`)
`m_a_p__TerminalTraj` (mixer weight `1.0`)
`nvidia__Nemotron_Terminal_Corpus__dataset_adapters` (mixer weight `1.0`)
`nvidia__Nemotron_Terminal_Corpus__skill_based_easy` (mixer weight `1.0`)
`nvidia__Nemotron_Terminal_Corpus__skill_based_medium` (mixer weight `1.0`)
`nvidia__Nemotron_Terminal_Corpus__skill_based_mixed` (mixer weight `1.0`)
`open_thoughts__OpenThoughts_Agent_v1_SFT` (mixer weight `1.0`)
`skill_tax_20260505_2.2k_combined_balanced_thinking_all` (mixer weight `1.0`)
Split: train
Transforms: sft_tulu_tokenize_and_truncate_v1, sft_tulu_filter_v1
Dataset cache hash: 8cd5377c34
| Field | Value |
|---|---|
| Base model | hamishivi/Qwen3-8B |
| Local model path | /gpfs/scrubbed/osey/tmax/models/hamishivi/Qwen3-8B |
| Max seq length | 32768 |
| Sequence-parallel size | 1 |
| Per-device batch size | 2 |
| Gradient accumulation | 4 |
| Effective batch size | 128 |
| Packing | true |
| Learning rate | 1e-5 |
| LR scheduler | linear |
| Warmup ratio | 0.1 |
| Epochs | 2 |
| Checkpoint every | 250 steps |
| Seed | 123 |
| Optimizer kernel | Liger |
| Mixed precision | bf16 |
| Gradient checkpointing | true |
| DeepSpeed config | stage2_no_offloading_accelerate.conf |
28 (total 16)117347 on g[007,021]20260516_120450tmax-full-sft (run name: sft_qwen3_8b_tmax_full_0513_2node)sbatch scripts/slurm/sft/qwen/sft_qwen3_8b_tmax_full_0513_2node.sh