Downloads · 30 days
34
31% of all-time downloads
KingsonHO/Qwen3.8-27B-w8a8
Qwen3.8-27B-w8a8 is a machine learning model from KingsonHO. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Downloads · 30 days
34
31% of all-time downloads
All-time downloads
111
Public
Repo size
32.1 GB
Likes
0
Public
Click a slice to open those files.
.safetensors32.1 GB · 100%
From the Hugging Face model README
| 项目 | 信息 |
|---|---|
| 原始模型名 | Qwen3.8-27B |
| 原始模型链接 | Qwen/Qwen3.8-27B |
| msmodelslim 仓库 | https://gitcode.com/keith_wa/ModelSlim_joejoezhou_qwen38/tree/qwen3_8_27b_adapter |
| msmodelslim commit id | 173fc3787b496d4ef2e1e995bbf17c19f65a2083 |
pip install transformers==5.14.0
msmodelslim quant --model_type Qwen3.8-27B --quant_type w8a8 --model_path weight/Qwen3.8-27B --save_path weight/Qwen3.8-27B-w8a8 --device npu:0,1,2,3,4,5,6,7 --trust_remote_code True
| 模型名 | 量化格式 | 数据集 | 测试精度 % | 官方精度 % |
|---|---|---|---|---|
| Qwen3.8-27B-w8a8 | w8a8 | GPQA | 89.9 | 89.2 |