Downloads · 30 days
0
0% of all-time downloads
tokenspeed-attention
kernels-staging/tokenspeed-attention
tokenspeed-attention is a machine learning model from kernels-staging. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for kernels. The card lists the license as mit.
This is the repository card of kernels-community/tokenspeed-attention that has been pushed on the Hub. It was built to be used with the kernels library. This card was automatically generated.
All-time downloads
2
Public
Repo size
—
Likes
0
Public
Repo makeup
Click a slice to open those files.
Other1.5 KB · 62%
At a glance
- Library
- kernels
- License
- mit
- Access
- Public
- Created
- Jun 23, 2026
- Updated
- Jun 23, 2026
- SHA
- f44d9348
Model card
From the Hugging Face model README
This is the repository card of kernels-community/tokenspeed-attention that has been pushed on the Hub. It was built to be used with the kernels library. This card was automatically generated.
How to use
# make sure `kernels` is installed: `pip install -U kernels`
from kernels import get_kernel
kernel_module = get_kernel("kernels-community/tokenspeed-attention", version=1)
__version__ = kernel_module.__version__
__version__(...)
Available functions
__version__mha_prefillmha_extend_with_kvcachemha_decode_with_kvcachemla_prefillmla_decode_with_kvcacheattn_merge_statetriton_mha_prefilltriton_mha_extend_with_kvcachetriton_mha_decode_with_kvcachetriton_mla_prefilltriton_mla_decode_with_kvcachetriton_attn_merge_state
Benchmarks
No benchmark available yet.
- Library
- kernels
- License
- mit
- Created
- Jun 23, 2026
- Updated
- Jun 23, 2026