Downloads · 30 days
0
alpaca-adapter-30b-4bit
wyklq/alpaca-adapter-30b-4bit
alpaca-adapter-30b-4bit is a machine learning model from wyklq. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
Finetuned LoRA model with command $llmtune finetune --model llama-30b-4bit --weights llama-30b-4bit.pt --dataset data50.json --adapter alpaca-adapter-folder-30b-4bit
Access
Public
Updated May 19, 2023
Repo size
51.2 MB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin51.2 MB · 100%
At a glance
- License
- other
- Access
- Public
- Created
- May 19, 2023
- Updated
- May 19, 2023
- SHA
- 999bfcbc
Model card
From the Hugging Face model README
Finetuned LoRA model with command $llmtune finetune --model llama-30b-4bit --weights llama-30b-4bit.pt --dataset data50.json --adapter alpaca-adapter-folder-30b-4bit
Using first 50 records of Alpaca dataset from original dataset.json The training loss is almost flat, and result is clearly better than original llama-30b-4bit model.
License shall follow typical Alpaca family models situation.
- License
- other
- Created
- May 19, 2023
- Updated
- May 19, 2023