Downloads · 30 days
8
22% of all-time downloads
LLaMa2-Qlora-AiresAi
lusstta/LLaMa2-Qlora-AiresAi
LLaMa2-Qlora-AiresAi is a machine learning model from lusstta. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
Adapter train using Qlora made for LLaMa2 7b Chat. This adapter adds the ability to fully, fluently and uninterruptedly speak other languages to LLaMa2.
All-time downloads
37
Public
Repo size
134 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin134 MB · 100%
At a glance
- Library
- peft
- Access
- Public
- Created
- Jul 24, 2023
- Updated
- Sep 20, 2023
- SHA
- 213f3ef2
Base models
Model card
From the Hugging Face model README
About
Adapter train using Qlora made for LLaMa2 7b Chat. This adapter adds the ability to fully, fluently and uninterruptedly speak other languages to LLaMa2.
Training procedure
The following bitsandbytes quantization config was used during training:
- load_in_8bit: False
- load_in_4bit: True
- llm_int8_threshold: 6.0
- llm_int8_skip_modules: None
- llm_int8_enable_fp32_cpu_offload: False
- llm_int8_has_fp16_weight: False
- bnb_4bit_quant_type: nf4
- bnb_4bit_use_double_quant: False
- bnb_4bit_compute_dtype: float16
Framework versions
- PEFT 0.5.0.dev0
- Library
- peft
- Created
- Jul 24, 2023
- Updated
- Sep 20, 2023