Downloads · 30 days
0
adamo1139/yi-34b-200k-xlctx-aezakmi-raw-toxic-dpo-sft-orpo-lora-0205
yi-34b-200k-xlctx-aezakmi-raw-toxic-dpo-sft-orpo-lora-0205 is a machine learning model from adamo1139. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Collection of LoRA files for my finetune. First, there was DPO on adamo1139/rawrrv2-2stage1 for 1 epoch. Then, SFT training on adamo1139/AEZAKMIv3-7 for 0.5 epochs. Then, ORPO training on adamo1139/toxic-dpo-natural-v…
Downloads · 30 days
0
Access
Public
Updated May 27, 2024
Repo size
2.9 GB
Likes
0
Public
Click a slice to open those files.
.safetensors2.9 GB · 100%
From the Hugging Face model README
Collection of LoRA files for my finetune. First, there was DPO on adamo1139/rawrr_v2-2_stage1 for 1 epoch. Then, SFT training on adamo1139/AEZAKMI_v3-7 for 0.5 epochs. Then, ORPO training on adamo1139/toxic-dpo-natural-v5 for 1 epoch.
I like the resulting model so far, it does feel very natural and uncensored, ORPO training really turned out nicely and was also super quick! Exciting for models in the future for sure!