Downloads · 30 days
0
SonnetLlama
GeneralRincewind/SonnetLlama
SonnetLlama is a machine learning model from GeneralRincewind. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
https://colab.research.google.com/drive/1Dlm8FA9JjjcqJIkfCagaIQWex8Ho5IKIscrollTo=e8xIjRNsl3Bb
Access
Public
Updated Aug 13, 2023
Repo size
—
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json1.8 MB · 100%
At a glance
- Access
- Public
- Created
- Aug 13, 2023
- Updated
- Aug 13, 2023
- SHA
- 78af0b80
Model card
From the Hugging Face model README
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("GeneralRincewind/SonnetLlama")
model = AutoModelForCausalLM.from_pretrained("GeneralRincewind/SonnetLlama")
#### Generate text
from transformers import TextStreamer
tokenized_text = tokenizer("", return_tensors="pt", truncation=True)
input_ids = tokenized_text.input_ids
streamer = TextStreamer(tokenizer)
model.eval()
full_completion = model.generate(inputs=tokenized_text["input_ids"].to("cuda"),
attention_mask=tokenized_text["attention_mask"].to("cuda"),
temperature=0.9,
top_k=80,
top_p=0.65,
do_sample=True,
streamer=streamer,
num_beams=1,
max_new_tokens=500,
eos_token_id=tokenizer.eos_token_id,
pad_token_id=tokenizer.pad_token_id,
repetition_penalty=1)
decoded_text = tokenizer.decode(full_completion[0])
print(decoded_text)
https://colab.research.google.com/drive/1Dlm8FA9JjjcqJIkfCagaIQWex8Ho5IKI#scrollTo=e8xIjRNsl3Bb
- Created
- Aug 13, 2023
- Updated
- Aug 13, 2023