Downloads · 30 days
16
12% of all-time downloads
Qwen2.5-1.5B-gptqmodel-4bit
iproskurina/Qwen2.5-1.5B-gptqmodel-4bit
Qwen2.5-1.5B-gptqmodel-4bit is a text generation model from iproskurina. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
132
Public
Parameters
1.5B
1.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.1 GB · 99%
Parameter types
How the weights are stored.
I321.3B · 85%
Try a prompt
Datasets
Model card
From the Hugging Face model README
Qwen2.5-1.5B - GPTQ (4-bit)
Source model: Qwen/Qwen2.5-1.5B
This model was quantized to 4-bit using GPTQModel.
Quantization parameters:
- bits: 4
- group_size: 128
- damp_percent: 0.05
- desc_act: False
Usage
# pip install transformers gptqmodel --no-build-isolation
from gptqmodel import GPTQModel
model_id = "iproskurina/Qwen2.5-1.5B-gptqmodel-4bit"
model = GPTQModel.load(model_id)
result = model.generate("Uncovering deep insights")[0]
print(model.tokenizer.decode(result))
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- apache-2.0
- Languages
- en
- Created
- Oct 30, 2025
- Updated
- Oct 30, 2025