Downloads · 30 days
4
3% of all-time downloads
Qwen3-1.7B-AutoRound_W4A16
MilyaShams/Qwen3-1.7B-AutoRound_W4A16
Qwen3-1.7B-AutoRound_W4A16 is a machine learning model from MilyaShams. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This model was compressed using the llmcompressor framework.
All-time downloads
134
Public
Parameters
2B
1.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.5 GB · 99%
Parameter types
How the weights are stored.
I321.7B · 84%
Base models
Model card
From the Hugging Face model README
Compressed Model: MilyaShams/Qwen3-1.7B-AutoRound_W4A16
This model was compressed using the llmcompressor framework.
Compression Details
- Base Model: Qwen/Qwen3-1.7B
- Experiment Name: AutoRound_W4A16
- Recipe / Modifiers Applied:
config_groups=None targets=['Linear'] ignore=[] scheme='W4A16' kv_cache_scheme=None weight_observer=None input_observer=None output_observer=None observer=None bypass_divisibility_checks=False index=None group=None start=None end=None update=None initialized_=True finalized_=True started_=True ended_=True sequential_targets=['Qwen3DecoderLayer'] iters=200 enable_torch_compile=True batch_size=2 lr=None device_ids='0,1'
Note: This model card was automatically generated. All structural modifiers and parameters used during compression are logged above.
- Type
- qwen3
- Created
- Apr 8, 2026
- Updated
- Apr 8, 2026