Downloads · 30 days
4
2% of all-time downloads
Qwen3-1.7B-AutoRound_W8A8
MilyaShams/Qwen3-1.7B-AutoRound_W8A8
Qwen3-1.7B-AutoRound_W8A8 is a machine learning model from MilyaShams. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This model was compressed using the llmcompressor framework.
All-time downloads
211
Public
Parameters
2B
2.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.3 GB · 99%
Parameter types
How the weights are stored.
I81.7B · 85%
Base models
Model card
From the Hugging Face model README
Compressed Model: MilyaShams/Qwen3-1.7B-AutoRound_W8A8
This model was compressed using the llmcompressor framework.
Compression Details
- Base Model: Qwen/Qwen3-1.7B
- Experiment Name: AutoRound_W8A8
- Recipe / Modifiers Applied:
config_groups=None targets=['Linear'] ignore=[] scheme='W8A8' kv_cache_scheme=None weight_observer=None input_observer=None output_observer=None observer=None bypass_divisibility_checks=False index=None group=None start=None end=None update=None initialized_=True finalized_=True started_=True ended_=True sequential_targets=['Qwen3DecoderLayer'] iters=200 enable_torch_compile=True batch_size=2 lr=None device_ids='0,1'
Note: This model card was automatically generated. All structural modifiers and parameters used during compression are logged above.
- Type
- qwen3
- Created
- Apr 8, 2026
- Updated
- Apr 8, 2026