Downloads · 30 days
15
16% of all-time downloads
marcusnogueira/qwen3guard-gen-8b-gptq-8bit
qwen3guard-gen-8b-gptq-8bit is a machine learning model from marcusnogueira. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Reproducible GPTQ 8-bit quantization of Qwen/Qwen3Guard-Gen-8B at revision 4505cb1a6f1864f21f8b27f7daf1b9a1aab6edbb.
Downloads · 30 days
15
16% of all-time downloads
All-time downloads
94
Public
Parameters
8.2B
19.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors9.6 GB · 100%
How the weights are stored.
I326.9B · 85%
From the Hugging Face model README
Reproducible GPTQ 8-bit quantization of
Qwen/Qwen3Guard-Gen-8B at revision
4505cb1a6f1864f21f8b27f7daf1b9a1aab6edbb.
2.0.0GPTQModel==7.1.0bfloat1665ea2fdb18470289314defc0fb94e27d4877b62143569615a1ce01745607ce1f1588ec454efa1a09f29cd18ddd04fe05fc8653a242{
"group_size": 128,
"sym": true,
"desc_act": false,
"true_sequential": true,
"lm_head": false,
"pack_dtype": "int32",
"format": "gptq",
"damp_percent": 0.05,
"damp_auto_increment": 0.01,
"act_group_aware": true,
"static_groups": false,
"mse": 0.0,
"hessian": {
"chunk_size": null,
"chunk_bytes": null,
"staging_dtype": "float32"
},
"bits": 8
}
{
"batch_size": 4,
"calibration_sort": "desc",
"calibration_concat_size": null,
"calibration_data_min_length": 10,
"calibration_concat_separator": null
}
The complete runtime environment, resolved checkpoint metadata, and file hashes
are stored in runtime_environment.json, quantization_manifest.json, and
SHA256SUMS.
The checkpoint that preceded this reproducible build is preserved under the
v1-original tag. Consumers that require an immutable dependency should pin a
tag or commit SHA instead of relying on main.