Downloads · 30 days
9
8% of all-time downloads
falcon-180B-chat-asst-ds-lora
smangrul/falcon-180B-chat-asst-ds-lora
falcon-180B-chat-asst-ds-lora is a machine learning model from smangrul. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
Fine-tuned version of Falcon-180B using PEFT LoRA + DeepSpeed ZeRO3 + Flash Attention + Activation Checkpointing. Read the blog Falcon 180B Finetuning using 🤗 PEFT and DeepSpeed for more information.
All-time downloads
119
Public
Repo size
535 MB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin535 MB · 100%
At a glance
- Library
- peft
- License
- apache-2.0
- Access
- Public
- Created
- Oct 2, 2023
- Updated
- Oct 2, 2023
- SHA
- 1e2636f8
Datasets
Model card
From the Hugging Face model README
Training procedure
Fine-tuned version of Falcon-180B using PEFT LoRA + DeepSpeed ZeRO3 + Flash Attention + Activation Checkpointing. Read the blog Falcon 180B Finetuning using 🤗 PEFT and DeepSpeed for more information.
Framework versions
- PEFT 0.6.0.dev0
- Library
- peft
- License
- apache-2.0
- Created
- Oct 2, 2023
- Updated
- Oct 2, 2023