Downloads · 30 days
28
100% of all-time downloads
qwen3-4b-thinking-l1
Samll/qwen3-4b-thinking-l1
qwen3-4b-thinking-l1 is a machine learning model from Samll. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
Paper: Efficient Reasoning Training Does Not Always Harm CoT Faithfulness and Monitorability
All-time downloads
28
Public
Repo size
144 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors132 MB · 89%
At a glance
- Library
- peft
- Access
- Public
- Created
- Sep 14, 2026
- Updated
- Oct 2, 2026
- SHA
- 30f593d3
Base models
Model card
From the Hugging Face model README
qwen3-4b-thinking-l1
Paper: Efficient Reasoning Training Does Not Always Harm CoT Faithfulness and Monitorability
Collection: Efficient Reasoning: CoT Faithfulness & Monitorability
Method: L1 / LCPO-Exact (Aggarwal & Welleck, 2025)
Hyperparameters
| Base model | Qwen/Qwen3-4B-Thinking-2507 |
| Method | L1 / LCPO-Exact |
| Released as | LoRA adapter, step 200 |
| n_min / n_max / alpha | 100 / 4,000 / 0.0003 |
| LoRA | rank 16, alpha 32, dropout 0, all attention and MLP projections |
| Optimiser | AdamW, learning rate 1e-5, KL coefficient 0 |
| Batch | 32 prompts x 16 generations |
| Sampling | temperature 0.8, top-p 0.95 |
| Data | numina_amc_aime (PRIME Eurus-2-RL-Data), ~2,223 prompts |
| Checkpoint selection | AIME22, every 50 steps |
| Hardware | 2x NVIDIA GH200 |
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-4B-Thinking-2507", torch_dtype="auto", device_map="auto")
tok = AutoTokenizer.from_pretrained("Qwen/Qwen3-4B-Thinking-2507")
model = PeftModel.from_pretrained(base, "Samll/qwen3-4b-thinking-l1")
To set a budget, append the instruction to the prompt, e.g. "... Think for 1000 tokens." (the paper uses 512, 1000 and 3000).
- Library
- peft
- Created
- Sep 14, 2026
- Updated
- Oct 2, 2026