Downloads · 30 days
12
22% of all-time downloads
llama-2-7b-chinese
zhehuderek/llama-2-7b-chinese
llama-2-7b-chinese is a text generation model from zhehuderek. Use it when you need the model to write or continue text. It is set up for transformers.
This a Chinese LLaMA2, built upon the original LLaMA2 with continue pre-training on 12B corpus.
All-time downloads
54
Public
Parameters
6.9B
27.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors27.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Dec 4, 2024
- Updated
- Dec 4, 2024
- SHA
- e59a2e17
Try a prompt
Model card
From the Hugging Face model README
Model Card for Model ID
This a Chinese LLaMA2, built upon the original LLaMA2 with continue pre-training on 12B corpus.
Continue Pre-training Data:
- WuDaoCorpora
- BaiduBaike
- Baidu News
- Tiger Dataset
- C4 samples
SFT Data:
- Chinese SFT Data:
- Alpaca-GPT4-zh
- InstinWild-ch
- Psychology-instruction
- Firefly dataset
- English SFT Data:
- Code-Alpaca
- InstinWild-en
- School-math dataset
- Ultrachat dataset
Results
- CEval: 34.47%
- CMMLU: 34.58%
- MMLU: 41.23%
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Dec 4, 2024
- Updated
- Dec 4, 2024