Downloads · 30 days
8
2% of all-time downloads
bloomz-3b-Instruction
acul3/bloomz-3b-Instruction
bloomz-3b-Instruction is a machine learning model from acul3. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as bigscience-openrail-m.
All-time downloads
399
Public
Repo size
6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin6 GB · 100%
At a glance
- Library
- transformers
- License
- bigscience-openrail-m
- Access
- Public
- Created
- Feb 16, 2023
- Updated
- Feb 16, 2023
- SHA
- 358fa16a
Model card
From the Hugging Face model README
how to use
from transformers import AutoModelForCausalLM, AutoTokenizer
import textwrap, time
MAX_NEW_TOKENS = 300
model_name = "acul3/bloomz-3b-Instruction"
model = AutoModelForCausalLM.from_pretrained(
model_name,
device_map='auto',
load_in_8bit= True
)
def generate_text(text):
tokenizer = AutoTokenizer.from_pretrained(model_name)
text = "User: " + text + "\n\Asisten: "
input_ids = tokenizer(text, return_tensors="pt").input_ids.to("cuda")
generated_ids = model.generate(input_ids, max_length=MAX_NEW_TOKENS, pad_token_id=tokenizer.eos_token_id, do_sample=True, top_p=0.95, temperature=0.5, penalty_alpha=0.6, top_k=4, repetition_penalty=1.03, num_return_sequences=1)
result = textwrap.wrap(tokenizer.decode(generated_ids[0], skip_special_tokens=True), width=128)
result[0] = result[0].split("Asisten:")[-1]
return "\n".join(result)
print(generate_text("cara merebus telur"))
- Library
- transformers
- License
- bigscience-openrail-m
- Created
- Feb 16, 2023
- Updated
- Feb 16, 2023