Skip to content

fbaldassarri

ibm-granite_granite-3.2-2b-instruct-autoround-int8-gs128-sym

fbaldassarri/ibm-granite_granite-3.2-2b-instruct-autoround-int8-gs128-sym

ibm-granite_granite-3.2-2b-instruct-autoround-int8-gs128-sym is a text generation model from fbaldassarri. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

Quantized version of ibm-granite/granite-3.2-2b-instruct using torch.float32 for quantization tuning. - 8 bits (INT8) - group size = 128 - Symmetrical Quantization - Method WoQ (AutoRound format)

Downloads · 30 days

14

18% of all-time downloads

All-time downloads

77

Public

Parameters

734M

2.9 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors2.9 GB · 100%

Parameter types

How the weights are stored.

I32614M · 84%

Try a prompt

Base models

Task
Text Generation
Library
transformers
Type
granite
License
apache-2.0
Languages
en, es, fr, de, pt, ja
Created
Apr 18, 2025
Updated
Apr 18, 2025