Downloads · 30 days
49
1% of all-time downloads
RichardErkhov/r3dhummingbird_-_DialoGPT-medium-joshua-gguf
r3dhummingbird_-_DialoGPT-medium-joshua-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
49
1% of all-time downloads
All-time downloads
4.3K
Public
Repo size
5 GB
Likes
0
Public
Click a slice to open those files.
.gguf5.8 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
DialoGPT-medium-joshua - GGUF
| Name | Quant method | Size |
|---|---|---|
| DialoGPT-medium-joshua.Q2_K.gguf | Q2_K | 0.17GB |
| DialoGPT-medium-joshua.IQ3_XS.gguf | IQ3_XS | 0.18GB |
| DialoGPT-medium-joshua.IQ3_S.gguf | IQ3_S | 0.19GB |
| DialoGPT-medium-joshua.Q3_K_S.gguf | Q3_K_S | 0.19GB |
| DialoGPT-medium-joshua.IQ3_M.gguf | IQ3_M | 0.2GB |
| DialoGPT-medium-joshua.Q3_K.gguf | Q3_K | 0.21GB |
| DialoGPT-medium-joshua.Q3_K_M.gguf | Q3_K_M | 0.21GB |
| DialoGPT-medium-joshua.Q3_K_L.gguf | Q3_K_L | 0.23GB |
| DialoGPT-medium-joshua.IQ4_XS.gguf | IQ4_XS | 0.22GB |
| DialoGPT-medium-joshua.Q4_0.gguf | Q4_0 | 0.23GB |
| DialoGPT-medium-joshua.IQ4_NL.gguf | IQ4_NL | 0.23GB |
| DialoGPT-medium-joshua.Q4_K_S.gguf | Q4_K_S | 0.23GB |
| DialoGPT-medium-joshua.Q4_K.gguf | Q4_K | 0.25GB |
| DialoGPT-medium-joshua.Q4_K_M.gguf | Q4_K_M | 0.25GB |
| DialoGPT-medium-joshua.Q4_1.gguf | Q4_1 | 0.25GB |
| DialoGPT-medium-joshua.Q5_0.gguf | Q5_0 | 0.27GB |
| DialoGPT-medium-joshua.Q5_K_S.gguf | Q5_K_S | 0.27GB |
| DialoGPT-medium-joshua.Q5_K.gguf | Q5_K | 0.29GB |
| DialoGPT-medium-joshua.Q5_K_M.gguf | Q5_K_M | 0.29GB |
| DialoGPT-medium-joshua.Q5_1.gguf | Q5_1 | 0.29GB |
| DialoGPT-medium-joshua.Q6_K.gguf | Q6_K | 0.32GB |
| DialoGPT-medium-joshua.Q8_0.gguf | Q8_0 | 0.41GB |
thumbnail: https://raw.githubusercontent.com/RuolinZheng08/twewy-discord-chatbot/main/gif-demo/icon.png
tags:
license: mit
This is an instance of microsoft/DialoGPT-medium trained on a game character, Joshua from The World Ends With You. The data comes from a Kaggle game script dataset.
I built a Discord AI chatbot based on this model. Check out my GitHub repo.
Chat with the model:
from transformers import AutoTokenizer, AutoModelWithLMHead
tokenizer = AutoTokenizer.from_pretrained("r3dhummingbird/DialoGPT-medium-joshua")
model = AutoModelWithLMHead.from_pretrained("r3dhummingbird/DialoGPT-medium-joshua")
# Let's chat for 4 lines
for step in range(4):
# encode the new user input, add the eos_token and return a tensor in Pytorch
new_user_input_ids = tokenizer.encode(input(">> User:") + tokenizer.eos_token, return_tensors='pt')
# print(new_user_input_ids)
# append the new user input tokens to the chat history
bot_input_ids = torch.cat([chat_history_ids, new_user_input_ids], dim=-1) if step > 0 else new_user_input_ids
# generated a response while limiting the total chat history to 1000 tokens,
chat_history_ids = model.generate(
bot_input_ids, max_length=200,
pad_token_id=tokenizer.eos_token_id,
no_repeat_ngram_size=3,
do_sample=True,
top_k=100,
top_p=0.7,
temperature=0.8
)
# pretty print last ouput tokens from bot
print("JoshuaBot: {}".format(tokenizer.decode(chat_history_ids[:, bot_input_ids.shape[-1]:][0], skip_special_tokens=True)))