Downloads · 30 days
67
100% of all-time downloads
MiniCPM5-2B-GPTQ-Int4
AXERA-TECH/MiniCPM5-2B-GPTQ-Int4
MiniCPM5-2B-GPTQ-Int4 is a machine learning model from AXERA-TECH. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
原始模型：https://huggingface.co/openbmb/MiniCPM5-2B
All-time downloads
67
Public
Parameters
2.5B
2.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.1 GB · 100%
Parameter types
How the weights are stored.
I322B · 79%
Base models
Model card
From the Hugging Face model README
原始模型：https://huggingface.co/openbmb/MiniCPM5-2B
GPTQ Int4 量化参数：
quantize_config = QuantizeConfig(
method="gptq",
bits=4,
group_size=128,
desc_act=True,
static_groups=True,
sym=True,
act_group_aware=False,
)
以下几个参数是AX650的硬性要求，AX650只支持这种参数的GPTQ模型
bits=4,
static_groups=True,
sym=True,
desc_act=True 打开它有助于提升量化精度。
static_groups 和 act_group_aware是互斥项，不能同时为True。这是GPTQModel 中的量化逻辑决定的。
- Type
- llama
- License
- mit
- Created
- Sep 10, 2026
- Updated
- Sep 14, 2026