Downloads · 30 days
0
baize-lora-7B
project-baize/baize-lora-7B
baize-lora-7B is a machine learning model from project-baize. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-4.0.
<p align="center" <img width="500px" alt="Project Baize" src="https://user-images.githubusercontent.com/22514219/229195563-0cddfa74-e52f-4413-b4b4-e4ba489c4b3d.png" </p <hr
Access
Public
Updated Apr 10, 2023
Repo size
71.7 MB
Likes
37
Public
Repo makeup
Click a slice to open those files.
.bin71.7 MB · 100%
At a glance
- License
- cc-by-nc-4.0
- Access
- Public
- Created
- Apr 1, 2023
- Updated
- Apr 10, 2023
- SHA
- fc136c0c
Model card
From the Hugging Face model README
<p align="center">
<img width="500px" alt="Project Baize" src="https://user-images.githubusercontent.com/22514219/229195563-0cddfa74-e52f-4413-b4b4-e4ba489c4b3d.png">
</p>
<hr>
What's Baize?
Baize is an open-source chat model fine-tuned with LoRA. It uses 100k dialogs generated by letting ChatGPT chat with itself. We also use Alpaca's data to improve its performance. This repo contains 7B model.
Why it's called Baize?
Baize (白泽) is a mythical creature in Chinese folklore, who speaks human languages and knows everything. This is exactly what we expect from a chat model.
Training Parameters
- Base Model: LLaMA-7B
- Training Epoch: 1
- Batch Size: 64
- Maximum Input Length: 512
- Learning Rate: 2e-4
- LoRA Rank: 8
- Updated Modules: All Linears
Training Dataset
- Standford Alpaca (51,942)
- Quora Dialogs (54,456):
- StackOverflow Dialogs (57,046)
More details can be found in the Baize GitHub
- License
- cc-by-nc-4.0
- Created
- Apr 1, 2023
- Updated
- Apr 10, 2023