Downloads · 30 days
17
18% of all-time downloads
Qwen3.6-35B-A3B-w8a8
KingsonHO/Qwen3.6-35B-A3B-w8a8
Qwen3.6-35B-A3B-w8a8 is a machine learning model from KingsonHO. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
该模型和Qwen3.5-35B-A3B结构一致，msmodelslim已支持一键量化：
All-time downloads
96
Public
Repo size
39.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors39.8 GB · 100%
At a glance
- License
- apache-2.0
- Model type
- qwen3_5_moe
- Access
- Public
- Created
- Jun 14, 2026
- Updated
- Jun 14, 2026
- SHA
- 9a306a8c
Model card
From the Hugging Face model README
Qwen3.6-35B-A3B-w8a8
1. 基本信息
| 项目 | 信息 |
|---|---|
| 原始模型名 | Qwen3.6-35B-A3B |
| 原始模型链接 | Qwen3.6-35B-A3B |
| msmodelslim commit id | 99394e9404ed72d811205d7a30a6ae883653200a |
| 精度测试机型 | Atlas 800T A3 1台 |
| 精度测试平台 | docker vllm-ascend |
| 版本 | vllm-ascend:v0.18.0rc1 |
| 链接 | quay.io/ascend/vllm-ascend:v0.18.0rc1-a3-openeuler |
2 量化脚本：
该模型和Qwen3.5-35B-A3B结构一致，msmodelslim已支持一键量化：
msmodelslim quant \
--model_path weights/Qwen3.6-35B-A3B \
--save_path weights/Qwen3.6-35B-A3B-w8a8 \
--model_type Qwen3.5-35B-A3B \
--quant_type w8a8 \
--trust_remote_code True
3 精度测试结果
| 模型名 | 量化格式 | 数据集 | 测试精度 % | 本地浮点精度 % |
|---|---|---|---|---|
| Qwen3.6-35B-A3B-w8a8 | w8a8 | GPQA | 83.232 | 82.997 |
*--max-model-len 256000，精度存在波动，建议多次测试。
- Type
- qwen3_5_moe
- License
- apache-2.0
- Created
- Jun 14, 2026
- Updated
- Jun 14, 2026