Downloads · 30 days
24
7% of all-time downloads
marcusnogueira/qwen3guard-gen-8b-awq-4bit
qwen3guard-gen-8b-awq-4bit is a machine learning model from marcusnogueira. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Reproducible AWQ 4-bit quantization of Qwen/Qwen3Guard-Gen-8B at revision 4505cb1a6f1864f21f8b27f7daf1b9a1aab6edbb.
Downloads · 30 days
24
7% of all-time downloads
All-time downloads
348
Public
Parameters
8.2B
6.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors6.1 GB · 100%
How the weights are stored.
I326.9B · 85%
From the Hugging Face model README
Reproducible AWQ 4-bit quantization of
Qwen/Qwen3Guard-Gen-8B at revision
4505cb1a6f1864f21f8b27f7daf1b9a1aab6edbb.
2.0.0GPTQModel==7.1.0bfloat1665ea2fdb18470289314defc0fb94e27d4877b62143569615a1ce01745607ce1f1588ec454efa1a09f29cd18ddd04fe05fc8653a242{
"group_size": 128,
"sym": true,
"desc_act": false,
"true_sequential": true,
"lm_head": false,
"pack_dtype": "int32",
"format": "gemm",
"scale_search_chunked_activations": true,
"bits": 4
}
{
"batch_size": 4,
"calibration_sort": "desc",
"calibration_concat_size": null,
"calibration_data_min_length": 10,
"calibration_concat_separator": null
}
The complete runtime environment, resolved checkpoint metadata, and file hashes
are stored in runtime_environment.json, quantization_manifest.json, and
SHA256SUMS.
The checkpoint that preceded this reproducible build is preserved under the
v1-original tag. Consumers that require an immutable dependency should pin a
tag or commit SHA instead of relying on main.