Skip to content

zgce

acsr-y34b-4bpw-hb6-exl2

zgce/acsr-y34b-4bpw-hb6-exl2

acsr-y34b-4bpw-hb6-exl2 is a text generation model from zgce. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.

这是以Yi-34B-Llama为底座重新合并的模型,原本200K上下文底座在合并了几个非200K上下文LoRA后的效果好象不太行,所以使用与LoRA相配套的底座重新合并。 底座是4096上下文,按照Y34B原本的说法推理时支持最大32K上下文(Alpha 8),本人推建8K上下文(Alpha 2.5)。 这次合并我改了下LoRA合并的顺序,将limarpv3切到最后合并。

Downloads · 30 days

5

2% of all-time downloads

All-time downloads

306

Public

Repo size

18.7 GB

Likes

1

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors18.7 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
mit
Model type
llama
Access
Public
Created
Nov 16, 2023
Updated
Nov 16, 2023
SHA
32d06cce

Try a prompt

Task
Text Generation
Library
transformers
Type
llama
License
mit
Created
Nov 16, 2023
Updated
Nov 16, 2023