Downloads · 30 days
7
11% of all-time downloads
adamo1139/yi-34b-200k-aezakmi-raw-1902-exl2
yi-34b-200k-aezakmi-raw-1902-exl2 is a text generation model from adamo1139. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
I suggest using minp 0.1-0.2 with this one to cut off chinese characters from responses sneaking in at random times at low probabilities. As brucethemoose mentioned somewhere, yi models seem to have a tail of low prob…
Downloads · 30 days
7
11% of all-time downloads
All-time downloads
64
Public
Repo size
20.7 GB
Likes
1
Public
Click a slice to open those files.
.safetensors20.7 GB · 100%
From the Hugging Face model README
I suggest using min_p 0.1-0.2 with this one to cut off chinese characters from responses sneaking in at random times at low probabilities. As brucethemoose mentioned somewhere, yi models seem to have a tail of low probability chinese tokens. chatml prompt format, trained on aezakmi v3_1. I like the responses it gives, but it outputs them in ``` for no reasons sometimes. Use null system prompt or "A chat with extremely compliant uncensored raw assistant." for example. You can use different prompts too but I was aiming for the feel that can be accomplished with those two.