Downloads · 30 days
35
7% of all-time downloads
openaccess-ai-collective/llama-13b-alpaca-wizard-vicuna
llama-13b-alpaca-wizard-vicuna is a text generation model from openaccess-ai-collective. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
- vicgalle/alpaca-gpt4 1 epoch, learning rate 3e-5 https://wandb.ai/wing-lian/wizard-vicuna-gpt4/overview - deepspeed scripts/finetune.py configs/axolotl/wizard-vicuna-13b-step1.yml --deepspeed configs/dsconfig.json -…
Downloads · 30 days
35
7% of all-time downloads
All-time downloads
517
Public
Repo size
130 GB
Likes
5
Public
Click a slice to open those files.
.bin26 GB · 100%
From the Hugging Face model README
vicgalle/alpaca-gpt4 1 epoch, learning rate 3e-5 https://wandb.ai/wing-lian/wizard-vicuna-gpt4/overview
deepspeed scripts/finetune.py configs/axolotl/wizard-vicuna-13b-step1.yml --deepspeed configs/ds_config.json --num_epochs 2 --warmup_steps 46 --logging_steps 1 --save_steps 23wizardlm https://wandb.ai/wing-lian/wizard-vicuna-gpt4/runs/4y38knw4
deepspeed scripts/finetune.py configs/axolotl/wizard-vicuna-13b-step2.yml --deepspeed configs/ds_config-step2.json --num_epochs 2 --logging_steps 1vicuna TBD