Downloads · 30 days
107
21% of all-time downloads
Yoko_13B_Japanese_QLoRA
ganchengguang/Yoko_13B_Japanese_QLoRA
Yoko_13B_Japanese_QLoRA is a text generation model from ganchengguang. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This model is traned with llm-japanese-dataset dataset. And this model used a few of dataset by 50000 chat samples and 280000 non chat samples. Improved performance in Chinese and Japanese. Use the QLoRA to fine-tune…
All-time downloads
514
Public
Repo size
26 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin26 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- llama
- Access
- Public
- Created
- Aug 17, 2023
- Updated
- Aug 17, 2023
- SHA
- eb8ad786
Model card
From the Hugging Face model README
This model is traned with llm-japanese-dataset dataset. And this model used a few of dataset by 50000 chat samples and 280000 non chat samples.
Improved performance in Chinese and Japanese.
Use the QLoRA to fine-tune the vanilla Llama-2-13b-chat-hf.
And you can use test.py to test the model.
Recommend Generation parameters:
- temperature: 0.5~0.7
- top p: 0.65~1.0
- top k: 30~50
- repeat penalty: 1.03~1.17
Contribute by Yokohama Nationaly University Mori Lab.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- mit
- Languages
- ja, en, zh
- Created
- Aug 17, 2023
- Updated
- Aug 17, 2023