Skip to content

siddharthmb

2026.TA.gemma2_2b_tc8192_decb_l1w0.001_tarbb_lb2.0_ln1_dr20000_lr8e-04_bs4_sl14793862

siddharthmb/2026.TA.gemma2_2b_tc8192_decb_l1w0.001_tarbb_lb2.0_ln1_dr20000_lr8e-04_bs4_sl14793862

2026.TA.gemma2_2b_tc8192_decb_l1w0.001_tarbb_lb2.0_ln1_dr20000_lr8e-04_bs4_sl14793862 is a machine learning model from siddharthmb. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.

Sparse transcoder adapter for google/gemma-2-2b: a ReLU branch dec(relu(enc(x))) on every MLP of the frozen base model, trained in bridging mode so that base plus branch matches google/gemma-2-2b-it. The branch's feat…

Downloads · 30 days

13

25% of all-time downloads

All-time downloads

51

Public

Parameters

3.6B

7.2 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors14.4 GB · 100%

At a glance

Library
transformers
Model type
gemma2
Access
Public
Created
Mar 11, 2026
Updated
Oct 11, 2026
SHA
febf3d7a

Base models

Library
transformers
Type
gemma2
Created
Mar 11, 2026
Updated
Oct 11, 2026