Downloads · 30 days
10
2% of all-time downloads
aloobun/qwen-1_8b-bun-chat
qwen-1_8b-bun-chat is a text generation model from aloobun. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Downloads · 30 days
10
2% of all-time downloads
All-time downloads
457
Public
Parameters
1.8B
3.7 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.7 GB · 100%
From the Hugging Face model README
from transformers import AutoModelForCausalLM, AutoTokenizer, GenerationConfig
tokenizer = AutoTokenizer.from_pretrained("qwen-1_8b-bun-chat", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("qwen-1_8b-bun-chat", device_map="auto", trust_remote_code=True).eval()
response, _ = model.chat(tokenizer, "Hi, how are you?", history=None)
print(response)
#response, history = model.chat(tokenizer, "I'm so happy with my new wardrobe! The clothes I bought fit me perfectly and they look great.", history=history)
#print(response)