Downloads · 30 days
2
7% of all-time downloads
pat883/w4a8-fp8-wmma
w4a8-fp8-wmma is a machine learning model from pat883. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for kernels.
W4A8-FP8 WMMA dense GEMM and MoE GEMM (fat binary for gfx1200 + gfx1201).
Downloads · 30 days
2
7% of all-time downloads
All-time downloads
28
Public
Repo size
29.5 MB
Likes
0
Public
Click a slice to open those files.
.so29.5 MB · 100%
From the Hugging Face model README
W4A8-FP8 WMMA dense GEMM and MoE GEMM (fat binary for gfx1200 + gfx1201).
Built with kernel-builder for AMD RDNA4 (gfx1201).
Load with the kernels library:
from kernels import get_kernel
kernel = get_kernel("pat883/w4a8-fp8-wmma")
Requires a ROCm PyTorch build (torch 2.10 / ROCm 7.x) on an RDNA4 card. Built variants:
torch210-cxx11-rocm70andtorch210-cxx11-rocm71.