Skip to content

quark75

granite-4.2-3b-W4A16-GPTQ-gs32

quark75/granite-4.2-3b-W4A16-GPTQ-gs32

granite-4.2-3b-W4A16-GPTQ-gs32 is a text generation model from quark75. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

A 4-bit weight-only GPTQ quantization of ibm-granite/granite-4.2-3b, saved in compressed-tensors format for vLLM. On an AMD Radeon Pro V620 (RDNA2), vLLM served it at 65 tok/s single-sequence and ~1,000 tok/s aggregat…

Downloads · 30 days

27

34% of all-time downloads

All-time downloads

79

Public

Parameters

3.7B

2.8 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors2.8 GB · 100%

Parameter types

How the weights are stored.

I323.1B · 86%

Try a prompt

Base models

Task
Text Generation
Library
transformers
Type
granite
License
apache-2.0
Created
Sep 24, 2026
Updated
Sep 24, 2026