Skip to content

kaitchup

Mistral-7B-awq-4bit

kaitchup/Mistral-7B-awq-4bit

Mistral-7B-awq-4bit is a text generation model from kaitchup. Use it when you need the model to write or continue text. It is set up for transformers.

Mistral 7B quantized in 4-bit with AutoAWQ.

Downloads · 30 days

17

1% of all-time downloads

All-time downloads

1.6K

Public

Parameters

7.2B

4.2 GB on disk

Likes

1

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors4.2 GB · 100%

Parameter types

How the weights are stored.

I327B · 96%

Try a prompt

Task
Text Generation
Library
transformers
Type
mistral
Created
Nov 17, 2023
Updated
Nov 20, 2023