Downloads · 30 days
3
11% of all-time downloads
Llama-2-7b-4bit-32g-autogptq-QALoRA
kaitchup/Llama-2-7b-4bit-32g-autogptq-QALoRA
Llama-2-7b-4bit-32g-autogptq-QALoRA is a machine learning model from kaitchup. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
This adapter has been fine-tuned using quantization-aware LoRA (QA-LoRA).
All-time downloads
27
Public
Repo size
1.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt715 MB · 67%
At a glance
- Library
- peft
- Access
- Public
- Created
- Oct 12, 2023
- Updated
- Oct 13, 2023
- SHA
- 6ba45971
Model card
From the Hugging Face model README
Training procedure
This adapter has been fine-tuned using quantization-aware LoRA (QA-LoRA).
More details on the training procedure here: Fine-tune Quantized Llama 2 on Your GPU with QA-LoRA
The base model was quantized with AutoGPTQ INT4. You can find it here:
kaitchup/Llama-2-7b-4bit-32g-autogptq
Framework versions
- PEFT 0.4.0
- Library
- peft
- Created
- Oct 12, 2023
- Updated
- Oct 13, 2023