Skip to content

fbaldassarri

mistralai_Mistral-Small-24B-Base-2501-autoround-int8-gs128-sym

fbaldassarri/mistralai_Mistral-Small-24B-Base-2501-autoround-int8-gs128-sym

mistralai_Mistral-Small-24B-Base-2501-autoround-int8-gs128-sym is a text generation model from fbaldassarri. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.

Quantized version of mistralai/Mistral-Small-24B-Base-2501 using torch.float32 for quantization tuning. - 8 bits (INT8) - group size = 128 - Asymmetrical Quantization - Method WoQ (AutoRound format)

Downloads · 30 days

9

9% of all-time downloads

All-time downloads

102

Public

Parameters

7.1B

28.1 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors28.1 GB · 100%

Parameter types

How the weights are stored.

I325.6B · 79%

Try a prompt

Base models

Task
Text Generation
Type
mistral
License
apache-2.0
Languages
en, fr
Created
Mar 27, 2025
Updated
Mar 27, 2025