Downloads · 30 days
5
5% of all-time downloads
alpaca-2-7b-english-chat
iamshnoo/alpaca-2-7b-english-chat
alpaca-2-7b-english-chat is a machine learning model from iamshnoo. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as cc-by-4.0.
This represents the PEFT weights only. The base model is LLaMA 2 chat. Instruction finetuning was done using 4 bit QLoRA on a single A100 GPU with the PEFT config as given below. The dataset used for this instruction…
All-time downloads
109
Public
Repo size
269 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin134 MB · 100%
At a glance
- Library
- peft
- License
- cc-by-4.0
- Access
- Public
- Created
- Sep 27, 2023
- Updated
- Oct 8, 2023
- SHA
- ca3a02cc
Datasets
Model card
From the Hugging Face model README
This represents the PEFT weights only. The base model is LLaMA 2 chat. Instruction finetuning was done using 4 bit QLoRA on a single A100 GPU with the PEFT config as given below. The dataset used for this instruction finetuning process is the cleaned alpaca dataset.
Do note that this model might have inferior performance on some specific tasks compared to full finetuning or a different base model trained with more specific data.
Training procedure
The following bitsandbytes quantization config was used during training:
- load_in_8bit: False
- load_in_4bit: True
- llm_int8_threshold: 6.0
- llm_int8_skip_modules: None
- llm_int8_enable_fp32_cpu_offload: False
- llm_int8_has_fp16_weight: False
- bnb_4bit_quant_type: nf4
- bnb_4bit_use_double_quant: True
- bnb_4bit_compute_dtype: bfloat16
Framework versions
- PEFT 0.4.0
- Library
- peft
- License
- cc-by-4.0
- Languages
- en
- Created
- Sep 27, 2023
- Updated
- Oct 8, 2023