Skip to content

yuyijiong

LongAlpaca-7b-32k-chinese

yuyijiong/LongAlpaca-7b-32k-chinese

LongAlpaca-7b-32k-chinese is a text generation model from yuyijiong. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.

v2版本已经推出,相比于v1提升明显,回答质量更高。 LongAlpaca使用LongLora训练技术,通过对 llama2-chat 进行位置插值后,再使用少量长文本数据进行指令微调,展现出了优秀的长文本对话能力。 LongAlpaca-7b-chinese 和 LongAlpaca 使用类似的训练方法:先使用线性位置插值,然后通过少量长文本数据的微调,使其获得优秀的长文本对话能力。 使用的中文数据集与LongAlpaca较为类…

Downloads · 30 days

15

3% of all-time downloads

All-time downloads

483

Public

Repo size

28 GB

Likes

2

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin14 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
cc-by-nc-4.0
Model type
llama
Access
Public
Created
Oct 25, 2023
Updated
Nov 21, 2023
SHA
13a99b2e
Task
Text Generation
Library
transformers
Type
llama
License
cc-by-nc-4.0
Languages
zh, en
Created
Oct 25, 2023
Updated
Nov 21, 2023