Skip to content

LoneStriker

airoboros-l2-70b-gpt4-1.4.1-2.4bpw-h6-exl2

LoneStriker/airoboros-l2-70b-gpt4-1.4.1-2.4bpw-h6-exl2

airoboros-l2-70b-gpt4-1.4.1-2.4bpw-h6-exl2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.

Simple quantization of original model. This model should fit on a single 24 GB VRAM GPU where Exlalama v2 is supported. Should also support full 4096 context on a single GPU, without dsktop apps also running on the sa…

Downloads · 30 days

4

1% of all-time downloads

All-time downloads

290

Public

Repo size

21.3 GB

Likes

6

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors21.3 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
other
Model type
llama
Access
Public
Created
Sep 18, 2023
Updated
Dec 9, 2023
SHA
c4032543

Try a prompt

Task
Text Generation
Library
transformers
Type
llama
License
other
Created
Sep 18, 2023
Updated
Dec 9, 2023