Downloads · 30 days
6
21% of all-time downloads
BereavedCompound-v1.0-24b-W4A16-AutoRound
hoborific/BereavedCompound-v1.0-24b-W4A16-AutoRound
BereavedCompound-v1.0-24b-W4A16-AutoRound is a machine learning model from hoborific. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
4-bit quant using Intel AutoRound, This is essentially the default W4A16 scheme
All-time downloads
28
Public
Parameters
1.3B
14.3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors14.2 GB · 100%
Parameter types
How the weights are stored.
I322.8B · 65%
Base models
Model card
From the Hugging Face model README
4-bit quant using Intel AutoRound, This is essentially the default W4A16 scheme
quant details
{
"bits": 4,
"group_size": 128,
"sym": true,
"data_type": "int",
"batch_size": 1,
"gradient_accumulate_steps": 8,
"autoround_version": "0.9.2",
"quant_method": "auto-round",
"packing_format": "auto_round:auto_gptq"
}
- Type
- mistral
- Created
- Dec 6, 2025
- Updated
- Dec 6, 2025