Skip to content

LoneStriker

Yi-34B-Spicyboros-3.1-2-4.0bpw-h6-exl2

LoneStriker/Yi-34B-Spicyboros-3.1-2-4.0bpw-h6-exl2

Yi-34B-Spicyboros-3.1-2-4.0bpw-h6-exl2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.

Three epochs of fine tuning with @jondurbin's SpicyBoros-3.1 dataset. 4.65bpw should fit on a single 3090/4090, 5.0bpw, 6.0bpw, and 8.0bpw will require more than one GPU 24 GB VRAM GPU.

Downloads · 30 days

6

10% of all-time downloads

All-time downloads

59

Public

Repo size

18 GB

Likes

1

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors18 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
other
Model type
llama
Access
Public
Created
Nov 17, 2023
Updated
Nov 17, 2023
SHA
9d388333

Try a prompt

Task
Text Generation
Library
transformers
Type
llama
License
other
Created
Nov 17, 2023
Updated
Nov 17, 2023