Downloads · 30 days
0
falcon-7b-qlora-chat-support-bot-faq
curiousily/falcon-7b-qlora-chat-support-bot-faq
falcon-7b-qlora-chat-support-bot-faq is a text generation model from curiousily. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Falcon 7b model trained on FAQ from an ecommerce website.
Access
Public
Updated Jun 6, 2023
Repo size
1.2 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin18.9 MB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- Jun 1, 2023
- Updated
- Jun 6, 2023
- SHA
- 06b691e2
Try a prompt
Model card
From the Hugging Face model README
Falcon 7b model trained on FAQ from an ecommerce website.
Tutorials
- Text tutorial: https://www.mlexpert.io/prompt-engineering/fine-tuning-llm-on-custom-dataset-with-qlora
- YouTube video: https://www.youtube.com/watch?v=DcBC4yGHV4Q
Training
Fine-tuned using the QLoRA technique (only adapter uploaded). With the help of bitsandbytes, peft and transformers. Full reproduction is available in the tutorials.
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Languages
- en
- Created
- Jun 1, 2023
- Updated
- Jun 6, 2023