Skip to content

MartaSamoilenko

Mistral-7b-int4-quantized-AWQ

MartaSamoilenko/Mistral-7b-int4-quantized-AWQ

Mistral-7b-int4-quantized-AWQ is a text generation model from MartaSamoilenko. Use it when you need the model to write or continue text. It is set up for transformers.

Downloads · 30 days

67

6% of all-time downloads

All-time downloads

1.2K

Public

Parameters

7.2B

4.2 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors4.2 GB · 100%

Parameter types

How the weights are stored.

I327B · 96%

Try a prompt

Task
Text Generation
Library
transformers
Type
mistral
Created
Mar 13, 2024
Updated
Mar 14, 2024