Skip to content

siddharthmb

2026.TA.gemma2_2b_tc8192_decb_l1w0.001_tarbb_lb2.0_ln1_dr10000_lr8e-04_bs4_sl14700393

siddharthmb/2026.TA.gemma2_2b_tc8192_decb_l1w0.001_tarbb_lb2.0_ln1_dr10000_lr8e-04_bs4_sl14700393

2026.TA.gemma2_2b_tc8192_decb_l1w0.001_tarbb_lb2.0_ln1_dr10000_lr8e-04_bs4_sl14700393 is a machine learning model from siddharthmb. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.

Sparse transcoder adapter for google/gemma-2-2b: a ReLU branch dec(relu(enc(x))) on every MLP of the frozen base model, trained in bridging mode so that base plus branch matches google/gemma-2-2b-it. The branch's feat…

Downloads · 30 days

10

9% of all-time downloads

All-time downloads

116

Public

Parameters

3.6B

7.2 GB on disk

Likes

1

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors14.4 GB · 100%

At a glance

Library
transformers
Model type
gemma2
Access
Public
Created
Mar 4, 2026
Updated
Oct 11, 2026
SHA
5287589f

Base models

Library
transformers
Type
gemma2
Created
Mar 4, 2026
Updated
Oct 11, 2026