Downloads · 30 days
76
6% of all-time downloads
nzl-thu/LLaDA-Instruct-JustGRPO-Code
LLaDA-Instruct-JustGRPO-Code is a text generation model from nzl-thu. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This model is LLaDA-8B-Instruct fine-tuned with JustGRPO on coding tasks.
Downloads · 30 days
76
6% of all-time downloads
All-time downloads
1.3K
Public
Parameters
8B
32.1 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors32.1 GB · 100%
From the Hugging Face model README
This model is LLaDA-8B-Instruct fine-tuned with JustGRPO on coding tasks.
It was introduced in the paper The Flexibility Trap: Why Arbitrary Order Limits Reasoning Potential in Diffusion Language Models.
JustGRPO is a minimalist RL approach for diffusion language models. Instead of complex diffusion-specific RL adaptations, we simply treat dLLMs as autoregressive models during training and apply standard GRPO. See our paper for details.
| Sequence Length | 128 | 256 | 512 |
|---|---|---|---|
| Pass@1 (%) | 37.8 | 49.4 | 48.7 |
| Sequence Length | 128 | 256 | 512 |
|---|---|---|---|
| Pass@1 (%) | 50.6 | 52.4 | 49.0 |
For generation and evaluation, please refer to our GitHub repository.
@article{ni2026flexibility,
title={The Flexibility Trap: Why Arbitrary Order Limits Reasoning Potential in Diffusion Language Models},
author={Ni, Zanlin and Wang, Shenzhi and Yue, Yang and Yu, Tianyu and Zhao, Weilin and Hua, Yeguo and Chen, Tianyi and Song, Jun and Yu, Cheng and Zheng, Bo and Huang, Gao},
journal={arXiv preprint arXiv:2601.15165},
year={2026}
}