crestf411

daybreak-kunoichi-2dpo-7b

crestf411/daybreak-kunoichi-2dpo-7b

daybreak-kunoichi-2dpo-7b is a text generation model from crestf411. Use it when you need the model to write or continue text. It is set up for transformers.

Experimental model doing a DPO training on top of Kunoichi-DPO-v2-7b, i.e. double-DPO.