Downloads · 30 days
10
8% of all-time downloads
PIPPA-ShareGPT-Subset-QLora-13b
zarakiquemparte/PIPPA-ShareGPT-Subset-QLora-13b
PIPPA-ShareGPT-Subset-QLora-13b is a machine learning model from zarakiquemparte. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as other.
It is an experimental Lora focused on Roleplay that uses a subset of PIPPA ShareGPT
All-time downloads
124
Public
Repo size
251 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin251 MB · 100%
At a glance
- Library
- peft
- License
- other
- Access
- Public
- Created
- Sep 3, 2023
- Updated
- Sep 4, 2023
- SHA
- f6736e34
Model card
From the Hugging Face model README
Model Card for PIPPA ShareGPT Subset QLora 13b
It is an experimental Lora focused on Roleplay that uses a subset of PIPPA ShareGPT
Usage
Custom
SYSTEM: Do thing
USER: {prompt}
CHARACTER:
Bias, Risks, and Limitations
This Lora is not intended for supplying factual information or advice in any form
Training Details
Training Data
1k of conversation from PIPPA ShareGPT
Training Procedure
The version of this Lora uploaded on this repository was trained using a 8x RTX A6000 cluster in 8-bit with regular LoRA adapters and 32-bit AdamW optimizer.
Training Hyperparameters
Training using a fork of Axolotl with two paths Patch 1 Patch 2
- load_in_4bit: true
- lora_r: 16
- lora_alpha: 16
- lora_dropout: 0.01
- gradient_accumulation_steps: 8
- micro_batch_size: 4
- num_epochs: 3
- learning_rate: 0.000065
Environmental Impact
Finetuning this model on 8xNVIDIA A6000 48GB in parallel takes about 30 minutes (13B)
- Library
- peft
- License
- other
- Created
- Sep 3, 2023
- Updated
- Sep 4, 2023