gsm-cot-llama3b-nl

gsm-cot-llama3b-nl

Natural-language chain-of-thought SFT checkpoint, fine-tuned from meta-llama/Llama-3.2-3B-Instruct on GSM8k-Aug with natural-language reasoning steps. From the paper Bridging the Gap Between Latent and Explicit Reasoning with Looped Transformers.

This is the Stage-1 CoT initialization for the natural-language LOTUS model (yingfanbot/gsm-lotus-llama3b-nl).

It is a standard causal LM — load with from_pretrained and generate the CoT directly (no wrapper needed).

Citation

@article{fan2026bridging,
  title={Bridging the Gap Between Latent and Explicit Reasoning with Looped Transformers},
  author={Fan, Ying and Svete, Anej and Lee, Kangwook},
  journal={arXiv preprint arXiv:2606.31779},
  year={2026}
}