Skip to content

LoneStriker

Yi-34B-Spicyboros-3.1-3-4.0bpw-h6-exl2

LoneStriker/Yi-34B-Spicyboros-3.1-3-4.0bpw-h6-exl2

Yi-34B-Spicyboros-3.1-3-4.0bpw-h6-exl2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.

Three epochs of fine tuning with @jondurbin's SpicyBoros-3.1 dataset. 5.0bpw and 5.15bpw should fit on a single 3090/4090 (may need to enable 8-bit cache), 6.0bpw, and 8.0bpw will require more than one GPU 24 GB VRAM…

Downloads · 30 days

8

16% of all-time downloads

All-time downloads

51

Public

Repo size

18 GB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors18 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
other
Model type
llama
Access
Public
Created
Nov 19, 2023
Updated
Nov 19, 2023
SHA
3615c0f5

Try a prompt

Task
Text Generation
Library
transformers
Type
llama
License
other
Created
Nov 19, 2023
Updated
Nov 19, 2023