Downloads · 30 days
17
28% of all-time downloads
math-think-s1-qwen3-4b
modrill/math-think-s1-qwen3-4b
math-think-s1-qwen3-4b is a text generation model from modrill. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Full-parameter SFT of Qwen3-4B-Base for math reasoning with explicit thinking blocks (qwen3 template + enablethinking: true).
All-time downloads
60
Public
Parameters
4B
8.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen3
- Access
- Public
- Created
- Jun 12, 2026
- Updated
- Jun 12, 2026
- SHA
- 3aea1e41
Try a prompt
Base models
Model card
From the Hugging Face model README
math_think_s1
Full-parameter SFT of Qwen3-4B-Base for math reasoning with explicit thinking blocks (qwen3 template + enable_thinking: true).
Base model
Training data
- Dataset:
math_think_s1— 75,905 ShareGPT samples - Source: qihoo360/Light-R1-SFTData (
stage1-76k.json) - Decontamination: MinHash + numeric normalization vs AIME/MATH eval prompts (1 sample removed)
Training recipe
| Item | Value |
|---|---|
| Framework | LLaMA-Factory |
| Method | Full SFT, DeepSpeed ZeRO-3 |
| Template | qwen3 (reasoning / thinking) |
| Cutoff | 32768 |
| Packing | true |
| Epochs | 4 |
| LR | 1e-5 (cosine, warmup 10%) |
| Batch | 1 × 16 grad accum × 4 GPUs = 64 |
| Steps | 944 |
| Train loss | 0.6066 |
| Runtime | ~39.3 h |
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "YOUR_HF_USERNAME/math-think-s1-qwen3-4b" # replace after upload
tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype="auto", device_map="auto")
messages = [{"role": "user", "content": "Find the sum of all positive integers n such that n^2 + 12n - 2007 is a perfect square."}]
text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True, enable_thinking=True)
Files
Release tarball includes: model.safetensors, config.json, generation_config.json, tokenizer files, chat_template.jinja, README.md, train_results.json, trainer_log.jsonl, MANIFEST.txt.
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3
- License
- apache-2.0
- Created
- Jun 12, 2026
- Updated
- Jun 12, 2026