Downloads · 30 days
3
2% of all-time downloads
jiwonsong/SeerAttention-Gemma3-12B-AttnGates
SeerAttention-Gemma3-12B-AttnGates is a text generation model from jiwonsong. Use it when you need the model to write or continue text. It is set up for transformers.
Experimental SeerAttention AttnGates for Gemma 3 12B IT. Trained for chunked-prefill SeerAttention / CompactAttention experiments.
Downloads · 30 days
3
2% of all-time downloads
All-time downloads
136
Public
Repo size
126 MB
Likes
0
Public
Click a slice to open those files.
.pth126 MB · 100%
From the Hugging Face model README
Experimental SeerAttention AttnGates for Gemma 3 12B IT. Trained for chunked-prefill SeerAttention / CompactAttention experiments.