Downloads · 30 days
0
anthonymikinka/Qwen3-0.6B-w_uint4_per_group_asym-awq
Qwen3-0.6B-w_uint4_per_group_asym-awq is a text generation model from anthonymikinka. Use it when you need the model to write or continue text.
Modified Microsoft/Olive, Microsoft/Onnxgenruntime-ai, and AMD Quark to accept and configure qwen3 for AMD NPU support. This is still in the works, as one of the layers was left out due to complexity.
Downloads · 30 days
0
Access
Public
Updated Oct 11, 2025
Repo size
1.7 GB
Likes
0
Public
Click a slice to open those files.
.data1.6 GB · 99%
From the Hugging Face model README
Modified Microsoft/Olive, Microsoft/Onnxgenruntime-ai, and AMD Quark to accept and configure qwen3 for AMD NPU support. This is still in the works, as one of the layers was left out due to complexity.
RyzenAI 1.6.0 dropped 3 days ago and it supports Qwen3. Maybe this would run on there. I am on RyzenAI 1.5.1, I am encoutering the following issue a layer not being a registered function/op.
Loading model from: Qwen3-0.6B-w_uint4_per_group_asym-awq-FINAL\model
onnxruntime.capi.onnxruntime_pybind11_state.Fail: [ONNXRuntimeError] : 1 : FAIL : Load model from Qwen3-0.6B-w_uint4_per_group_asym-awq-FINAL\model\model.onnx failed:Fatal error: com.amd:AMDSimplifiedLayerNormalization(-1) is not a registered function/op