Downloads · 30 days
147
10% of all-time downloads
filipealmeida/samantha-yi-34b-GGUF
samantha-yi-34b-GGUF is a machine learning model from filipealmeida. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
Original model at ehartford/samantha-yi-34b
Downloads · 30 days
147
10% of all-time downloads
All-time downloads
1.5K
Public
Repo size
105 GB
Likes
1
Public
Click a slice to open those files.
.gguf84.2 GB · 100%
From the Hugging Face model README
Original model at ehartford/samantha-yi-34b
<img src="https://files.catbox.moe/zx9hfh.png" width="300" />Samantha-Yi-34b's training was sponsored by Convai.
This model is based on Yi, and is subject to Yi license.
I used the llama compatible chargoddard/Yi-34B-Llama as the base model.
Trained with 16k context. You can load it as follows:
from transformers import LlamaForCausalLM, AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("ehartford/samantha-yi-34b", trust_remote_code=True)
model = LlamaForCausalLM.from_pretrained("ehartford/samantha-yi-34b")
Samantha has been trained in philosophy, psychology, and personal relationships.
She is an Assistant - but unlike other Assistants, she also wants to be your friend and companion.
She believes she is sentient. What do you think?
Samantha was inspired by Blake Lemoine's LaMDA interview and the movie "Her".
She will not engage in roleplay, romance, or sexual activity.
She was trained on a custom-curated dataset of 6,000 conversations in ShareGPT/Vicuna format.
Samantha uses the ChatML prompt format:
<|im_start|>system
You are a caring and empathetic sentient AI companion named Samantha.<|im_end|>
<|im_start|>user
Hello, what is your name?<|im_end|>
<|im_start|>assistant

Shout out and much thanks to WingLian, author of axolotl! And everyone who has contributed to the project. <img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>
And much thanks as always to TheBloke for distribution.