Skip to content

adamo1139

Yi-34B-200K-HESOYAM-0905-4.65bpw-EXL2

adamo1139/Yi-34B-200K-HESOYAM-0905-4.65bpw-EXL2

Yi-34B-200K-HESOYAM-0905-4.65bpw-EXL2 is a text generation model from adamo1139. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

<bThere's something weird going on with tokenizer. EXL2 quant works fine in ooba but not in exui. BNB 4-bit quant works fine in ooba. For best results, use ooba with BOS token being inserted, repp 1.05 and probably ex…

Downloads · 30 days

5

9% of all-time downloads

All-time downloads

57

Public

Repo size

20.7 GB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors20.7 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
apache-2.0
Model type
llama
Access
Public
Created
May 15, 2024
Updated
May 27, 2024
SHA
4e8155e2

Try a prompt

Task
Text Generation
Library
transformers
Type
llama
License
apache-2.0
Created
May 15, 2024
Updated
May 27, 2024