Downloads · 30 days
25
5% of all-time downloads
shafire/talktoaiQT
talktoaiQT is a text generation model from shafire. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
GGUF WORKING TESTED MODEL NEWER ONE SIMILAR TO THIS IS HERE https://huggingface.co/shafire/talktoaiQ
Downloads · 30 days
25
5% of all-time downloads
All-time downloads
482
Public
Repo size
16.2 GB
Likes
1
Public
Click a slice to open those files.
.safetensors16.2 GB · 100%
From the Hugging Face model README
**GGUF WORKING TESTED MODEL NEWER ONE SIMILAR TO THIS IS HERE https://huggingface.co/shafire/talktoaiQ **
This model was trained using AutoTrain reflection data sets re-written with talktoai data sets using quantum interdimensional math and a new math system I made myself, also i took DNA math patterns and put them into the training too! For more information, please visit AutoTrain.
from transformers import AutoModelForCausalLM, AutoTokenizer
model_path = "PATH_TO_THIS_REPO"
tokenizer = AutoTokenizer.from_pretrained(model_path)
model = AutoModelForCausalLM.from_pretrained(
model_path,
device_map="auto",
torch_dtype='auto'
).eval()
# Prompt content: "hi"
messages = [
{"role": "user", "content": "hi"}
]
input_ids = tokenizer.apply_chat_template(conversation=messages, tokenize=True, add_generation_prompt=True, return_tensors='pt')
output_ids = model.generate(input_ids.to('cuda'))
response = tokenizer.decode(output_ids[0][input_ids.shape[1]:], skip_special_tokens=True)
# Model response: "Hello! How can I assist you today?"
print(response)