Downloads · 30 days
14
9% of all-time downloads
Qwen2.5-7B-gptqmodel-4bit
iproskurina/Qwen2.5-7B-gptqmodel-4bit
Qwen2.5-7B-gptqmodel-4bit is a text generation model from iproskurina. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
149
Public
Parameters
7.6B
5.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5.6 GB · 100%
Parameter types
How the weights are stored.
I326.5B · 86%
Try a prompt
Datasets
Model card
From the Hugging Face model README
Qwen2.5-7B - GPTQ (4-bit)
Source model: Qwen/Qwen2.5-7B
This model was quantized to 4-bit using GPTQModel.
Quantization parameters:
- bits: 4
- group_size: 128
- damp_percent: 0.05
- desc_act: False
Usage
# pip install transformers gptqmodel --no-build-isolation
from gptqmodel import GPTQModel
model_id = "iproskurina/Qwen2.5-7B-gptqmodel-4bit"
model = GPTQModel.load(model_id)
result = model.generate("Uncovering deep insights")[0]
print(model.tokenizer.decode(result))
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- apache-2.0
- Languages
- en
- Created
- Oct 30, 2025
- Updated
- Oct 30, 2025