Skip to content

jiwonsong

SeerAttention-Qwen3-8B-AttnGates

jiwonsong/SeerAttention-Qwen3-8B-AttnGates

SeerAttention-Qwen3-8B-AttnGates is a text generation model from jiwonsong. Use it when you need the model to write or continue text. It is set up for transformers.

Experimental SeerAttention AttnGates for Qwen3-8B. Trained on RedPajama-1T-Sample Dataset.

Downloads · 30 days

10

2% of all-time downloads

All-time downloads

611

Public

Repo size

113 MB

Likes

1

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.pth113 MB · 100%

At a glance

Task
Text Generation
Library
transformers
Model type
qwen3
Access
Public
Created
Apr 4, 2026
Updated
Apr 6, 2026
SHA
ce40326c

Try a prompt

Base models

Task
Text Generation
Library
transformers
Type
qwen3
Created
Apr 4, 2026
Updated
Apr 6, 2026