gemma-7b-gptqmodel-4bit

iproskurina/gemma-7b-gptqmodel-4bit

gemma-7b-gptqmodel-4bit is a text generation model from iproskurina. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as gemma.

Downloads · 30 days

11% of all-time downloads

All-time downloads

Public

Parameters

8.5B

11.2 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors5.6 GB · 99%

Parameter types

How the weights are stored.

I327.8B · 91%

Try a prompt

Datasets

allenai/c4

Model card

From the Hugging Face model README

gemma-7b - GPTQ (4-bit)

Source model: google/gemma-7b

This model was quantized to 4-bit using GPTQModel.

Quantization parameters:

bits: 4
group_size: 128
damp_percent: 0.05
desc_act: False

Usage

            # pip install transformers gptqmodel --no-build-isolation
            from gptqmodel import GPTQModel
            model_id = "iproskurina/gemma-7b-gptqmodel-4bit"
            model = GPTQModel.load(model_id)
            result = model.generate("Uncovering deep insights")[0]
            print(model.tokenizer.decode(result))

Task: Text Generation
Library: transformers
Type: gemma
License: gemma
Languages: en
Created: Aug 24, 2025
Updated: Oct 31, 2025