gemma-3-1b-pt-gptqmodel-4bit

iproskurina/gemma-3-1b-pt-gptqmodel-4bit

gemma-3-1b-pt-gptqmodel-4bit is a text generation model from iproskurina. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as gemma.

Downloads · 30 days

4% of all-time downloads

All-time downloads

161

Public

Parameters

1000M

1 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors968 MB · 96%

Parameter types

How the weights are stored.

I32698M · 70%

Try a prompt

Datasets

allenai/c4

Model card

From the Hugging Face model README

gemma-3-1b-pt - GPTQ (4-bit)

Source model: google/gemma-3-1b-pt

This model was quantized to 4-bit using GPTQModel.

Quantization parameters:

bits: 4
group_size: 128
damp_percent: 0.05
desc_act: False

Usage

            # pip install transformers gptqmodel --no-build-isolation
            from gptqmodel import GPTQModel
            model_id = "iproskurina/gemma-3-1b-pt-gptqmodel-4bit"
            model = GPTQModel.load(model_id)
            result = model.generate("Uncovering deep insights")[0]
            print(model.tokenizer.decode(result))

Task: Text Generation
Library: transformers
Type: gemma3_text
License: gemma
Languages: en
Created: Oct 30, 2025
Updated: Oct 30, 2025