Downloads · 30 days
0
easypass7
brianc07/easypass7
easypass7 is a text generation model from brianc07. Use it when you need the model to write or continue text. The card lists the license as other.
Access
Public
Updated Mar 3, 2024
Repo size
82.4 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt54.6 MB · 48%
At a glance
- Task
- Text Generation
- License
- other
- Access
- Public
- Created
- Mar 3, 2024
- Updated
- Mar 3, 2024
- SHA
- 0dfcbc3f
Model card
From the Hugging Face model README
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model_path = "PATH_TO_THIS_REPO"
tokenizer = AutoTokenizer.from_pretrained(model_path)
model = AutoModelForCausalLM.from_pretrained(
model_path,
device_map="auto",
torch_dtype='auto'
).eval()
# Prompt content: "hi"
messages = [
{"role": "user", "content": "hi"}
]
input_ids = tokenizer.apply_chat_template(conversation=messages, tokenize=True, add_generation_prompt=True, return_tensors='pt')
output_ids = model.generate(input_ids.to('cuda'))
response = tokenizer.decode(output_ids[0][input_ids.shape[1]:], skip_special_tokens=True)
# Model response: "Hello! How can I assist you today?"
print(response)
- Task
- Text Generation
- License
- other
- Created
- Mar 3, 2024
- Updated
- Mar 3, 2024