Downloads · 30 days
50
0% of all-time downloads
Yi-6b-200k-dpo
chinoll/Yi-6b-200k-dpo
Yi-6b-200k-dpo is a text generation model from chinoll. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
All-time downloads
50.6K
Public
Parameters
6.1B
12.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors12.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- llama
- Access
- Public
- Created
- Dec 1, 2023
- Updated
- Dec 1, 2023
- SHA
- 925c5fba
Model card
From the Hugging Face model README
Examples
from transformers import AutoModelForCausalLM, AutoTokenizer
model_path = 'chinoll/Yi-6b-200k-dpo'
tokenizer = AutoTokenizer.from_pretrained(model_path, use_fast=False)
# Since transformers 4.35.0, the GPT-Q/AWQ model can be loaded using AutoModelForCausalLM.
model = AutoModelForCausalLM.from_pretrained(
model_path,
device_map="auto",
torch_dtype='auto'
).eval()
# Prompt content: "hi"
messages = [
{"role": "user", "content": "hi"}
]
input_ids = tokenizer.apply_chat_template(conversation=messages, tokenize=True, add_generation_prompt=True, return_tensors='pt')
output_ids = model.generate(input_ids.to('cuda'))
response = tokenizer.decode(output_ids[0][input_ids.shape[1]:], skip_special_tokens=True)
# Model response: "Hello! How can I assist you today?"
print(response)
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- other
- Languages
- zh, en
- Created
- Dec 1, 2023
- Updated
- Dec 1, 2023