Downloads · 30 days
0
0% of all-time downloads
kernels-staging/finegrained-fp8
finegrained-fp8 is a machine learning model from kernels-staging. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for kernels. The card lists the license as apache-2.0.
This is the repository card of kernels-community/finegrained-fp8 that has been pushed on the Hub. It was built to be used with the kernels library. This card was automatically generated.
Downloads · 30 days
0
0% of all-time downloads
All-time downloads
16
Public
Repo size
—
Likes
0
Public
Click a slice to open those files.
Other1.5 KB · 68%
From the Hugging Face model README
This is the repository card of kernels-community/finegrained-fp8 that has been pushed on the Hub. It was built to be used with the kernels library. This card was automatically generated.
# make sure `kernels` is installed: `pip install -U kernels`
from kernels import get_kernel
kernel_module = get_kernel("kernels-community/finegrained-fp8", version=4)
fp8_act_quant = kernel_module.fp8_act_quant
fp8_act_quant(...)
fp8_act_quantmatmul_2dmatmul_batchedmatmul_groupedmoe_fused_batchedmoe_fused_groupedNo benchmark available yet.