Downloads · 30 days
3
5% of all-time downloads
Lilitu-L3.3-70b-0.1-W4A16-AutoRound
hoborific/Lilitu-L3.3-70b-0.1-W4A16-AutoRound
Lilitu-L3.3-70b-0.1-W4A16-AutoRound is a machine learning model from hoborific. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
60
Public
Parameters
11.3B
39.8 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors39.8 GB · 100%
Parameter types
How the weights are stored.
I328.6B · 77%
Base models
Model card
From the Hugging Face model README
4-bit quant using Intel AutoRound
This is the default W4A16 scheme.
Quantization Details
at time of quantization, the default implied values not listed in the below json are as follows:
{"batch_size": 8, "iters": 200, "seqlen": 2048, "nsamples": 128, "lr": None}
quantization_config.json
{
"bits": 4,
"group_size": 128,
"sym": true,
"data_type": "int",
"low_gpu_mem_usage": true,
"autoround_version": "0.9.2",
"quant_method": "auto-round",
"packing_format": "auto_round:auto_gptq"
}
- Type
- llama
- Created
- Dec 8, 2025
- Updated
- Dec 8, 2025