Downloads · 30 days
12
19% of all-time downloads
QiHealth-6B-Beta
QiYuan-tech/QiHealth-6B-Beta
QiHealth-6B-Beta is a text generation model from QiYuan-tech. Use it when you need the model to write or continue text. It is set up for transformers.
All-time downloads
63
Public
Parameters
6.1B
12.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors12.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Jan 30, 2024
- Updated
- Jan 30, 2024
- SHA
- 73f52b2c
Try a prompt
Model card
From the Hugging Face model README
请使用以下代码运行我们的模型：
from transformers import AutoModelForCausalLM, AutoTokenizer
model_path = 'QiYuan-tech/QiHealth-6B-Beta'
tokenizer = AutoTokenizer.from_pretrained(model_path, use_fast=False)
model = AutoModelForCausalLM.from_pretrained(
model_path,
device_map="auto",
torch_dtype='auto'
).eval()
messages = [
{"role": "user", "content": "hi"}
]
input_ids = tokenizer.apply_chat_template(conversation=messages, tokenize=True, add_generation_prompt=True, return_tensors='pt')
output_ids = model.generate(input_ids.to('cuda'))
response = tokenizer.decode(output_ids[0][input_ids.shape[1]:], skip_special_tokens=True)
print(response)
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Jan 30, 2024
- Updated
- Jan 30, 2024