Skip to content

science-of-finetuning

gemma-2-2b-crosscoder-l13-mu4.1e-02-lr1e-04

science-of-finetuning/gemma-2-2b-crosscoder-l13-mu4.1e-02-lr1e-04

gemma-2-2b-crosscoder-l13-mu4.1e-02-lr1e-04 is a feature extraction model from science-of-finetuning. Use it when you need embeddings to search or compare text. The card lists the license as mit.

This crosscoder was trained on parallel activations of Gemma 2 2B and Gemma 2 2B IT at layer 13 on a subset of fineweb and lsmsy-chat-1m dataset.

Downloads · 30 days

20

1% of all-time downloads

All-time downloads

1.7K

Public

Parameters

680M

2.7 GB on disk

Likes

5

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors2.7 GB · 100%

At a glance

Task
Feature Extraction
License
mit
Access
Public
Created
Nov 22, 2024
Updated
Nov 22, 2024
SHA
7b67709b

Base models

Task
Feature Extraction
License
mit
Created
Nov 22, 2024
Updated
Nov 22, 2024