Downloads · 30 days
17
1% of all-time downloads
kaitchup/Llama-2-7b-4bit-32g-autogptq
Llama-2-7b-4bit-32g-autogptq is a text generation model from kaitchup. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Llama 2 7B quantized with AutoGPTQ V0.3.0.
Downloads · 30 days
17
1% of all-time downloads
All-time downloads
1.6K
Public
Repo size
4.3 GB
Likes
5
Public
Click a slice to open those files.
.bin4.3 GB · 100%
From the Hugging Face model README
Llama 2 7B quantized with AutoGPTQ V0.3.0.
This model is compatible with the first version of QA-LoRA.
To fine-tune it with QA-LoRA, follow this tutorial: Fine-tune Quantized Llama 2 on Your GPU with QA-LoRA