Downloads · 30 days
19
4% of all-time downloads
alexpaul/QI-Large-v1
QI-Large-v1 is a text generation model from alexpaul. Use it when you need the model to write or continue text. It is set up for transformers.
Downloads · 30 days
19
4% of all-time downloads
All-time downloads
430
Public
Repo size
14 GB
Likes
0
Public
Click a slice to open those files.
.bin7 GB · 100%
From the Hugging Face model README
Run the Model
tokenizer = LlamaTokenizer.from_pretrained("alexpaul/QI-large-v1")
base_model = LlamaForCausalLM.from_pretrained(
"alexpaul/QI-large-v1",
load_in_8bit=True,
device_map='auto',
)