Downloads · 30 days
120
13% of all-time downloads
laion/tt-x1_lr-lr4e6-30-30B
tt-x1_lr-lr4e6-30-30B is a text generation model from laion. Use it when you need the model to write or continue text. It is set up for transformers.
X1 learning-rate ablation arm (lr = 4e-6) of the TaskTrove hyperparameter sweep.
Downloads · 30 days
120
13% of all-time downloads
All-time downloads
900
Public
Parameters
30.5B
61.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors61.1 GB · 100%
From the Hugging Face model README
X1 learning-rate ablation arm (lr = 4e-6) of the TaskTrove hyperparameter sweep.
Qwen/Qwen3-Coder-30B-A3B-InstructDCAgent/exp_rpt_multifile (TaskTrove, pytest verifier, pass_ratio reward shaping)TERMINATED by owner at step 36/80 after reward collapsed to exactly 0.000 at steps 33-36 (a hard
collapse, not the gradual decay expected from an over-large learning rate). This is not a
completed / valid X1 result: it did not reach its 80-step horizon. Selected checkpoint =
global_step_30, the trailing-5 EMA peak (0.1700) among saved exports and the last healthy
checkpoint before the step-33 collapse. See training_logs/report.md for the full curve.
Companion trial-level trace dataset: https://huggingface.co/datasets/open-athena/tt-x1_lr-lr4e6
Per-step metric surface, the parse_skyrl_metrics.py analysis report, and the reward plot
(metrics.csv, report.md, reward_plot.png).