Downloads · 30 days
28
8% of all-time downloads
yifanyu/I-DLM-8B-lora-r128
I-DLM-8B-lora-r128 is a text generation model from yifanyu. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.
LoRA adapter (rank=128) for I-DLM-8B, enabling lossless Relaxed Introspective Strided Decoding (R-ISD).
Downloads · 30 days
28
8% of all-time downloads
All-time downloads
344
Public
Repo size
698 MB
Likes
2
Public
Click a slice to open those files.
.safetensors698 MB · 99%
From the Hugging Face model README
LoRA adapter (rank=128) for I-DLM-8B, enabling lossless Relaxed Introspective Strided Decoding (R-ISD).
This model was presented in the paper Introspective Diffusion Language Models.
This LoRA adapter is used in the gated LoRA setup described in the I-DLM paper:
Note: This LoRA adapter is used with the I-DLM-8B base model via our SGLang-based serving pipeline. Direct loading via
transformersis not currently supported for reproducing paper results. Please use the SGLang-based ISD pipeline for inference.
`