Downloads · 30 days
10
2% of all-time downloads
jiwonsong/SeerAttention-Qwen3-8B-AttnGates
SeerAttention-Qwen3-8B-AttnGates is a text generation model from jiwonsong. Use it when you need the model to write or continue text. It is set up for transformers.
Experimental SeerAttention AttnGates for Qwen3-8B. Trained on RedPajama-1T-Sample Dataset.
Downloads · 30 days
10
2% of all-time downloads
All-time downloads
611
Public
Repo size
113 MB
Likes
1
Public
Click a slice to open those files.
.pth113 MB · 100%
From the Hugging Face model README
Experimental SeerAttention AttnGates for Qwen3-8B. Trained on RedPajama-1T-Sample Dataset.