Downloads · 30 days
596
43% of all-time downloads
Chinese-CodeLlama-7B-SFT-V1
frankminors123/Chinese-CodeLlama-7B-SFT-V1
Chinese-CodeLlama-7B-SFT-V1 is a text generation model from frankminors123. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
We implemented SFT based on our Chinese-CodeLlama-7B-PT. The dataset comes from CodeLlama-2-20k, we used Google Translate to translate it into Chinese.
All-time downloads
1.4K
Public
Repo size
56.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin28.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Sep 27, 2023
- Updated
- Nov 20, 2023
- SHA
- 0c3629b3
Datasets
Model card
From the Hugging Face model README
Chinese-CodeLlama-7B-SFT-V1
We implemented SFT based on our Chinese-CodeLlama-7B-PT. The dataset comes from CodeLlama-2-20k, we used Google Translate to translate it into Chinese.
In addition, we designed appropriate Chinese prompt template for coding tasks, and during the fine-tuning stage, memory efficient attention was applied which save us a lot of GPU memory space.
The Chinese prompt template used is as follows:
PROMPT_TEMPLATE = (
"下面是描述一项任务的指令，并且与一则输入配对用来提供更多的上下文。请给出尽可能满足请求的回答.\n"
"### 指令:\n{instruction}\n### 输入:\n{input}\n### 回答:\n"
)
If you are interested in our work, please follow our progress in the future.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- zh
- Created
- Sep 27, 2023
- Updated
- Nov 20, 2023