Downloads · 30 days
6
8% of all-time downloads
Llama-2-7b-chat-hf-8-bit
anslin-raj/Llama-2-7b-chat-hf-8-bit
Llama-2-7b-chat-hf-8-bit is a text generation model from anslin-raj. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as bsd-3-clause.
All-time downloads
72
Public
Repo size
14 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- bsd-3-clause
- Model type
- llama
- Access
- Public
- Created
- Nov 24, 2023
- Updated
- Jan 4, 2024
- SHA
- e2cb68d5
Try a prompt
Model card
From the Hugging Face model README
from transformers import AutoTokenizer, AutoModelForCausalLM
HF_MODEL_REPO = "anslin-raj/Llama-2-7b-chat-hf-8-bit"
tokenizer = AutoTokenizer.from_pretrained(HF_MODEL_REPO, device=device)
model = AutoModelForCausalLM.from_pretrained(HF_MODEL_REPO, device_map=device, load_in_8bit=True)
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- bsd-3-clause
- Languages
- en
- Created
- Nov 24, 2023
- Updated
- Jan 4, 2024