Downloads · 30 days
0
llama-adapter-7b
winglian/llama-adapter-7b
llama-adapter-7b is a machine learning model from winglian. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
- Check out the demo: https://huggingface.co/spaces/winglian/llama-adapter - Read the paper: https://arxiv.org/abs/2303.16199 - PEFT PR: https://github.com/huggingface/peft/pull/268
Access
Public
Updated Apr 13, 2023
Repo size
4.9 MB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.bin4.9 MB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Apr 13, 2023
- Updated
- Apr 13, 2023
- SHA
- ff614023
Spaces
Model card
From the Hugging Face model README
- Check out the demo: https://huggingface.co/spaces/winglian/llama-adapter
- Read the paper: https://arxiv.org/abs/2303.16199
- PEFT PR: https://github.com/huggingface/peft/pull/268
training hyperparamters:
--batch_size 64 --micro_batch_size 8 --num_epochs 5 --learning_rate 9e-3 --cutoff_len 2048 --val_set_size 0.05 --train_on_inputs 0
training dataset: https://github.com/tloen/alpaca-lora/blob/main/alpaca_data_gpt4.json
- License
- mit
- Created
- Apr 13, 2023
- Updated
- Apr 13, 2023