Skip to content

siddharthmb

2026.TA.gemma2_2b_tc8192_decb_l1w0.001_tarbb_lb2.0_ln1_dr10000_lr3e-04_bs4_sl14701500

siddharthmb/2026.TA.gemma2_2b_tc8192_decb_l1w0.001_tarbb_lb2.0_ln1_dr10000_lr3e-04_bs4_sl14701500

2026.TA.gemma2_2b_tc8192_decb_l1w0.001_tarbb_lb2.0_ln1_dr10000_lr3e-04_bs4_sl14701500 is a machine learning model from siddharthmb. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.

Sparse transcoder adapter for google/gemma-2-2b: a ReLU branch dec(relu(enc(x))) on every MLP of the frozen base model, trained in bridging mode so that base plus branch matches google/gemma-2-2b-it. The branch's feat…

Downloads · 30 days

8

13% of all-time downloads

All-time downloads

64

Public

Parameters

3.6B

7.2 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors7.2 GB · 100%

At a glance

Library
transformers
Model type
gemma2
Access
Public
Created
Mar 4, 2026
Updated
Oct 11, 2026
SHA
8a076d0c

Base models

Library
transformers
Type
gemma2
Created
Mar 4, 2026
Updated
Oct 11, 2026