Skip to content

benk04

CausalLM-RP-34B-4.65bpw-h6-exl2

benk04/CausalLM-RP-34B-4.65bpw-h6-exl2

CausalLM-RP-34B-4.65bpw-h6-exl2 is a text generation model from benk04. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.

Exllamav2 4.65bpw quantization of CausalLM-RP-34B from NeverSleep, quantized with default calibration dataset. [!IMPORTANT] Fits in 24GB VRAM with 32k+ context. Make sure to enable 4-bit cache option or you'll run int…

Downloads · 30 days

5

10% of all-time downloads

All-time downloads

48

Public

Repo size

20.7 GB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors20.7 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
cc-by-nc-4.0
Model type
llama
Access
Public
Created
Jun 6, 2024
Updated
Jun 6, 2024
SHA
6f326424

Try a prompt

Task
Text Generation
Library
transformers
Type
llama
License
cc-by-nc-4.0
Created
Jun 6, 2024
Updated
Jun 6, 2024