Downloads · 30 days
69
16% of all-time downloads
Qwen3.5-35B-A3B-Base-AWQ-W4A16
Lambent/Qwen3.5-35B-A3B-Base-AWQ-W4A16
Qwen3.5-35B-A3B-Base-AWQ-W4A16 is a machine learning model from Lambent. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Attempted AWQ quantization using calibration dataset. Added placeholder 1 token images to the text calibration dataset. Took some messing around and might look weird; I needed to patch vLLM for support even though it…
All-time downloads
427
Public
Parameters
36.2B
22 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors22 GB · 100%
Parameter types
How the weights are stored.
I3233.6B · 93%
Base models
Model card
From the Hugging Face model README
Attempted AWQ quantization using calibration dataset. Added placeholder 1 token images to the text calibration dataset. Took some messing around and might look weird; I needed to patch vLLM for support even though it is trying to support Qwen3.5 out of the gate.
It's ... weird-shaped currently due to unpacking and might not be useful to anyone, lol. Seems slower than GGUF. Unsure how well it works. However, I spent a good few hours of my computer's time on making it happen, so releasing regardless.
- Type
- qwen3_5_moe
- License
- apache-2.0
- Created
- Feb 26, 2026
- Updated
- Feb 28, 2026