Downloads · 30 days
15
7% of all-time downloads
adamo1139/Yi-34B-200K-XLCTX-AEZAKMI-RAW-2904
Yi-34B-200K-XLCTX-AEZAKMI-RAW-2904 is a text generation model from adamo1139. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a Yi-34B-200K XLCTX model treated with DPO with adamo1139/rawrrv2-2stage1 and then SFT on adamo1139/AEZAKMIv3-7. It does work but it does have quite a lot of assistant feel to it. I am uploading full model sin…
Downloads · 30 days
15
7% of all-time downloads
All-time downloads
219
Public
Parameters
34.4B
68.8 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors68.8 GB · 100%
From the Hugging Face model README
This is a Yi-34B-200K XLCTX model treated with DPO with adamo1139/rawrr_v2-2_stage1 and then SFT on adamo1139/AEZAKMI_v3-7. It does work but it does have quite a lot of assistant feel to it. I am uploading full model since I want to compare it to model after ORPO on the Open LLM Leaderboard, but I would suggest using the version that underwent ORPO training on adamo1139/toxic-dpo-natural-v5 instead, as it's just more pleasant to talk to in my opinion.