Skip to content

adamo1139

Yi-34B-200K-rawrr1-LORA-DPO-experimental-r3

adamo1139/Yi-34B-200K-rawrr1-LORA-DPO-experimental-r3

Yi-34B-200K-rawrr1-LORA-DPO-experimental-r3 is a text generation model from adamo1139. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

Another QLoRA DPO training of Yi-34B-200K. This time with sequence length 500, lorar 16 and lora alpha 32. I was able to squeeze that in using Unsloth, script I used is in this repo. It definitely has much stronger ef…

Downloads · 30 days

100

0% of all-time downloads

All-time downloads

36.3K

Public

Repo size

493 MB

Likes

1

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors492 MB · 100%

At a glance

Task
Text Generation
Library
transformers
License
apache-2.0
Model type
llama
Access
Public
Created
Jan 22, 2024
Updated
May 27, 2024
SHA
30235f36

Try a prompt

Task
Text Generation
Library
transformers
Type
llama
License
apache-2.0
Created
Jan 22, 2024
Updated
May 27, 2024