Downloads · 30 days
0
alpaca-lora-30b-gpt4-en-zh
gradientai/alpaca-lora-30b-gpt4-en-zh
alpaca-lora-30b-gpt4-en-zh is a machine learning model from gradientai. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
This repo contains a low-rank adapter for LLaMA-30b fit on the GPT-4-LLM English and Chinese dataset.
Access
Public
Updated Apr 14, 2023
Repo size
51.2 MB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.bin51.2 MB · 100%
At a glance
- License
- other
- Access
- Public
- Created
- Apr 13, 2023
- Updated
- Apr 14, 2023
- SHA
- b8f341fa
Model card
From the Hugging Face model README
This repo contains a low-rank adapter for LLaMA-30b fit on the GPT-4-LLM English and Chinese dataset.
This version of the weights was trained with the following the default hyperparameters of alpaca-lora:
- Epochs: 3
- Batch size: 128
- Cutoff length: 256
- Learning rate: 3e-4
- Lora r: 8
- Lora target modules: q_proj, v_proj
Instructions for running it can be found at https://github.com/tloen/alpaca-lora.
Usage and License Notices
The licence of this LoRA weight is inherited from LLaMA's license, for research use only. In addition, the LoRA weight must not be used to compete with OpenAI, according to OpenAI's terms of use , because the dataset is generated from OpenAI API.
- License
- other
- Created
- Apr 13, 2023
- Updated
- Apr 14, 2023