Downloads · 30 days
6
9% of all-time downloads
satyajitghana/mistral-7b-v0.1-alpaca-chat
mistral-7b-v0.1-alpaca-chat is a text generation model from satyajitghana. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Downloads · 30 days
6
9% of all-time downloads
All-time downloads
69
Public
Parameters
7.2B
14.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors14.5 GB · 100%
From the Hugging Face model README
from transformers import AutoTokenizer, AutoModelForCausalLM, pipeline
import torch
tokenizer = AutoTokenizer.from_pretrained("satyajitghana/mistral-7b-v0.1-alpaca-chat")
model = AutoModelForCausalLM.from_pretrained(
"satyajitghana/mistral-7b-v0.1-alpaca-chat",
torch_dtype=torch.bfloat16,
device_map="auto"
)
pipe = pipeline(
"text-generation",
model=model,
tokenizer=tokenizer,
)
INPUT = """
### Instruction:
List 3 historical events related to the following country
### Input:
India
### Response:
"""
out = pipe(
INPUT,
max_new_tokens=200
)
print(out[0]['generated_text'])