Downloads · 30 days
17
5% of all-time downloads
Qwen1.5-72B-Chat-LLaMAfied
sayhan/Qwen1.5-72B-Chat-LLaMAfied
Qwen1.5-72B-Chat-LLaMAfied is a text generation model from sayhan. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This repo containst the "LLaMAfied" version of Qwen1.5-72B-Chat by Alibaba Cloud. I used the amazing script made by Minami-su to LLaMAfy the model.
All-time downloads
342
Public
Repo size
145 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin145 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- llama
- Access
- Public
- Created
- Feb 25, 2024
- Updated
- Feb 25, 2024
- SHA
- c8faae99
Try a prompt
Model card
From the Hugging Face model README
Description
This repo containst the "LLaMAfied" version of Qwen1.5-72B-Chat by Alibaba Cloud. I used the amazing script made by Minami-su to LLaMAfy the model.
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer, TextStreamer
tokenizer = AutoTokenizer.from_pretrained("sayhan/Qwen1.5-72B-Chat-LLaMAfied")
model = AutoModelForCausalLM.from_pretrained("sayhan/Qwen1.5-72B-Chat-LLaMAfied", torch_dtype="auto", device_map="auto")
streamer = TextStreamer(tokenizer, skip_prompt=True, skip_special_tokens=True)
messages = [
{"role": "user", "content": "Who are you?"}
]
inputs = tokenizer.apply_chat_template(messages, tokenize=True, add_generation_prompt=True, return_tensors="pt")
inputs = inputs.to("cuda")
generate_ids = model.generate(inputs,max_length=2048, streamer=streamer)
Other LLaMAfied Qwen1.5 Models
The two other sizes of the Qwen1.5 have been LLaMAfied by Minami-su
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- other
- Languages
- en, zh
- Created
- Feb 25, 2024
- Updated
- Feb 25, 2024