Skip to content

fbaldassarri

iGeniusAI_Italia-9B-Instruct-v0.1-autoawq-int4-gs128-sym

fbaldassarri/iGeniusAI_Italia-9B-Instruct-v0.1-autoawq-int4-gs128-sym

iGeniusAI_Italia-9B-Instruct-v0.1-autoawq-int4-gs128-sym is a text generation model from fbaldassarri. Use it when you need the model to write or continue text. The card lists the license as mit.

Quantized version of iGeniusAI/Italia-9B-Instruct-v0.1 using torch.float32 for quantization tuning. - 4 bits (INT4) - group size = 128 - Symmetrical Quantization - Method AutoAWQ

Downloads · 30 days

9

15% of all-time downloads

All-time downloads

59

Public

Parameters

8.3B

5.2 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors5.2 GB · 100%

Parameter types

How the weights are stored.

I328B · 97%

Base models

Task
Text Generation
Type
gpt_neox
License
mit
Languages
it
Created
Jan 7, 2025
Updated
Jan 7, 2025