Downloads · 30 days
14
5% of all-time downloads
datajuicer/LLaMA2-7B-ZH-Chat-52k
LLaMA2-7B-ZH-Chat-52k is a text generation model from datajuicer. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Our first data-centric LLM competition begins! Please visit the competition's official websites, FT-Data Ranker (1B Track, 7B Track), for more information. This is a reference LLM from Data-Juicer.
Downloads · 30 days
14
5% of all-time downloads
All-time downloads
292
Public
Repo size
56.1 GB
Likes
1
Public
Click a slice to open those files.
.bin28 GB · 100%
From the Hugging Face model README
Our first data-centric LLM competition begins! Please visit the competition's official websites, FT-Data Ranker (1B Track, 7B Track), for more information.
This is a reference LLM from Data-Juicer.
The model architecture is LLaMA2-7B and we built it upon the a pre-trained Chinese checkpoint from FlagAlpha. The model is fine-trained on 52k Chinese chat samples of Data-Juicer's refined alpaca-CoT data. It beats LLaMA2-7B fine-tuned on 543k Belle samples in GPT-4 evaluation.
For more details, please refer to our paper.
