Skip to content

jiwonsong

SeerAttention-Gemma3-12B-AttnGates

jiwonsong/SeerAttention-Gemma3-12B-AttnGates

SeerAttention-Gemma3-12B-AttnGates is a text generation model from jiwonsong. Use it when you need the model to write or continue text. It is set up for transformers.

Experimental SeerAttention AttnGates for Gemma 3 12B IT. Trained for chunked-prefill SeerAttention / CompactAttention experiments.

Downloads · 30 days

3

2% of all-time downloads

All-time downloads

136

Public

Repo size

126 MB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.pth126 MB · 100%

At a glance

Task
Text Generation
Library
transformers
Model type
gemma3_text
Access
Public
Created
Apr 27, 2026
Updated
Apr 27, 2026
SHA
219b355a

Try a prompt

Base models

Task
Text Generation
Library
transformers
Type
gemma3_text
Created
Apr 27, 2026
Updated
Apr 27, 2026