Downloads · 30 days
11
11% of all-time downloads
aloobun/Qwen-1_8B-m4-LDJnr-combined
Qwen-1_8B-m4-LDJnr-combined is a text generation model from aloobun. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Downloads · 30 days
11
11% of all-time downloads
All-time downloads
97
Public
Parameters
1.8B
3.7 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors3.7 GB · 100%
From the Hugging Face model README
from transformers import AutoModelForCausalLM, AutoTokenizer, GenerationConfig
tokenizer = AutoTokenizer.from_pretrained("Qwen-1_8B-m4-LDJnr-combined", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("Qwen-1_8B-m4-LDJnr-combined", device_map="auto", trust_remote_code=True).eval()
response, _ = model.chat(tokenizer, "What kind of a noise annoys a noisy oyster?", history=None)
print(response)