Skip to content

m33393

llama-65b-gptq-cuda-4bit-32g-safetensors

m33393/llama-65b-gptq-cuda-4bit-32g-safetensors

llama-65b-gptq-cuda-4bit-32g-safetensors is a text generation model from m33393. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.

Converted to HF with transformers 4.30.0.dev0, then quantized to 4 bit with GPTQ (Group size 32):

Downloads · 30 days

11

3% of all-time downloads

All-time downloads

361

Public

Repo size

38.5 GB

Likes

2

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors38.5 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
other
Model type
llama
Access
Public
Created
May 27, 2023
Updated
May 30, 2023
SHA
73b449dd

Try a prompt

Task
Text Generation
Library
transformers
Type
llama
License
other
Created
May 27, 2023
Updated
May 30, 2023