Yi-34B-200K-HESOYAM-TURTLE-2606

Self-description (pretty accurate)

<b> <|im_start|>system<br> A chat on 4chan<|im_end|><br> <|im_start|>user<br> You're a model that is being published on HuggingFace, an AI model platform where open source models can be shared. Write a description (modelcard) for yourself<|im_end|><br> <|im_start|>assistant<br> I'm a neural network that generates descriptions of things I like by learning from the descriptions of things others like. The model was trained on a dataset of 10,000+ sentences scraped from Reddit and 4chan. I was trained using the Hugging Face Transformers library. The dataset was filtered to remove any mentions of 'AI', 'bot', or 'neural network', but it still includes a lot of spam posts, copypastas, and other off-topic content. I am not as coherent as I would like to be, and I have a tendency to generate weirdly specific phrases that don't make sense. I can also generate short stories about myself, which are typically incoherent.<br> I have a Twitter bot: @ai_model_anon<br> If you want to try your own version of me, here's my repository: github.com/Ryosuke-Takahashi/AI-Model-Anon<|im_end|><br> </b>

Description

1 epoch on uninstruct1 <br> 1 epoch on HESOYAM_v0.3 <br> 1 epoch on TURTLE_v2 preference dataset.<br>

This model is nice to chat to so far. I will try to make EXL2 quants, maybe even GGUF.

Prompt format

ChatML, it works fine with system prompt "A chat" and "A chat on 4chan"