Downloads · 30 days
0
0% of all-time downloads
sage-attention
yetter-ai/sage-attention
sage-attention is a machine learning model from yetter-ai. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for kernels. The card lists the license as apache-2.0.
This is the repository card of yetter-ai/sage-attention that has been pushed on the Hub. It was built to be used with the kernels library.
All-time downloads
28
Public
Repo size
422 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.so369 MB · 100%
At a glance
- Library
- kernels
- License
- apache-2.0
- Access
- Public
- Created
- May 12, 2026
- Updated
- Jun 9, 2026
- SHA
- a9a56396
Model card
From the Hugging Face model README
This is the repository card of yetter-ai/sage-attention that has been pushed on the Hub. It was built to be used with the kernels library.
Build source: https://github.com/thu-ml/SageAttention Upstream commit: d1a57a546c3d395b1ffcbeecc66d81db76f3b4b5
How to use
# make sure `kernels` is installed: `pip install -U kernels`
from kernels import get_kernel
kernel_module = get_kernel("yetter-ai/sage-attention")
sageattn = kernel_module.sageattn
sageattn(...)
Available functions
per_block_int8per_warp_int8sub_meanper_channel_fp8sageattnsageattn_varlensageattn_qk_int8_pv_fp16_tritonsageattn_qk_int8_pv_fp16_cudasageattn_qk_int8_pv_fp8_cudasageattn_qk_int8_pv_fp8_cuda_sm90sageattn3_blackwell
Benchmarks
No benchmark available yet.
- Library
- kernels
- License
- apache-2.0
- Created
- May 12, 2026
- Updated
- Jun 9, 2026