Downloads · 30 days
10
26% of all-time downloads
Ram20307/qwen3-0.6b-gsm8k-arm-b-seed123
qwen3-0.6b-gsm8k-arm-b-seed123 is a machine learning model from Ram20307. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Part of the SLM Reasoning Research project — studying what kind of reasoning supervision content actually helps a small (0.6B) language model learn to reason.
Downloads · 30 days
10
26% of all-time downloads
All-time downloads
38
Public
Parameters
596M
2.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors2.4 GB · 100%
From the Hugging Face model README
Part of the SLM Reasoning Research project — studying what kind of reasoning supervision content actually helps a small (0.6B) language model learn to reason.
Arm: B
Concise reasoning — same logic as Arm A, compressed.
GSM8K test accuracy: 49% (49/100, n=100 subset).
{
"arm": "B",
"seed": 123,
"data_file": "results/exp05_arms_be/arm_b_concise_n7435_filtered.jsonl",
"n_examples": 7435,
"model_name": "Qwen/Qwen3-0.6B-Base",
"epochs": 3,
"learning_rate": 2e-05,
"per_device_batch_size": 2,
"grad_accum_steps": 8,
"effective_batch_size": 16,
"max_length": 768,
"optimizer": "adamw_torch",
"precision": "fp32_master_amp_fp16",
"gpu_name": "NVIDIA RTX A5000 Laptop GPU",
"python_version": "3.10.12",
"platform": "Linux-6.8.0-138-generic-x86_64-with-glibc2.35",
"torch_version": "2.5.1+cu124",
"transformers_version": "5.3.0",
"cuda_version": "12.4",
"git_commit": null,
"start_time": "2026-09-09T12:38:20.167385+00:00",
"end_time": "2026-09-09T13:23:40.442453+00:00",
"duration_seconds": 2720.275068,
"final_train_loss": 0.3714297248898441,
"train_runtime_seconds": 2712.4231,
"train_samples_per_second": 8.223
}
See the project repo for the full methodology, literature grounding, and comparison against the other reasoning-format arms.