gemma-2-4b-it-upscaled

Columbidae/gemma-2-4b-it-upscaled

gemma-2-4b-it-upscaled is a text generation model from Columbidae. Use it when you need the model to write or continue text. It is set up for transformers.

This is a merge of pre-trained language models created using mergekit.

Downloads · 30 days

21% of all-time downloads

All-time downloads

235

Public

Parameters

3.9B

7.8 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors7.7 GB · 100%

At a glance

Task: Text Generation
Library: transformers
Model type: gemma2
Access: Public
Created: Mar 10, 2025
Updated: Mar 10, 2025
SHA: e4c69ef1

Try a prompt

Base models

unsloth/gemma-2-2b-it

Model card

From the Hugging Face model README

merged

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Passthrough merge method.

Models Merged

The following models were included in the merge:

unsloth/gemma-2-2b-it

Configuration

The following YAML configuration was used to produce this model:

slices:
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [0,14]
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [14,15]
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [14,15]
      parameters:
        scale:
        - filter: o_proj
          value: 0.0
        - filter: down_proj
          value: 0.0
        - value: 1.0
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [14,15]
      parameters:
        scale:
        - filter: o_proj
          value: 0.0
        - filter: down_proj
          value: 0.0
        - value: 1.0
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [15,16]
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [15,16]
      parameters:
        scale:
        - filter: o_proj
          value: 0.0
        - filter: down_proj
          value: 0.0
        - value: 1.0
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [15,16]
      parameters:
        scale:
        - filter: o_proj
          value: 0.0
        - filter: down_proj
          value: 0.0
        - value: 1.0
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [16,17]
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [16,17]
      parameters:
        scale:
        - filter: o_proj
          value: 0.0
        - filter: down_proj
          value: 0.0
        - value: 1.0
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [16,17]
      parameters:
        scale:
        - filter: o_proj
          value: 0.0
        - filter: down_proj
          value: 0.0
        - value: 1.0
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [17,18]
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [17,18]
      parameters:
        scale:
        - filter: o_proj
          value: 0.0
        - filter: down_proj
          value: 0.0
        - value: 1.0
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [17,18]
      parameters:
        scale:
        - filter: o_proj
          value: 0.0
        - filter: down_proj
          value: 0.0
        - value: 1.0
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [18,19]
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [18,19]
      parameters:
        scale:
        - filter: o_proj
          value: 0.0
        - filter: down_proj
          value: 0.0
        - value: 1.0
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [18,19]
      parameters:
        scale:
        - filter: o_proj
          value: 0.0
        - filter: down_proj
          value: 0.0
        - value: 1.0
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [19,20]
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [19,20]
      parameters:
        scale:
        - filter: o_proj
          value: 0.0
        - filter: down_proj
          value: 0.0
        - value: 1.0
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [19,20]
      parameters:
        scale:
        - filter: o_proj
          value: 0.0
        - filter: down_proj
          value: 0.0
        - value: 1.0
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [20,21]
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [20,21]
      parameters:
        scale:
        - filter: o_proj
          value: 0.0
        - filter: down_proj
          value: 0.0
        - value: 1.0
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [20,21]
      parameters:
        scale:
        - filter: o_proj
          value: 0.0
        - filter: down_proj
          value: 0.0
        - value: 1.0
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [21,22]
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [21,22]
      parameters:
        scale:
        - filter: o_proj
          value: 0.0
        - filter: down_proj
          value: 0.0
        - value: 1.0
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [21,22]
      parameters:
        scale:
        - filter: o_proj
          value: 0.0
        - filter: down_proj
          value: 0.0
        - value: 1.0
  - sources:
    - model: unsloth/gemma-2-2b-it
      layer_range: [22,26]
merge_method: passthrough

Task: Text Generation
Library: transformers
Type: gemma2
Created: Mar 10, 2025
Updated: Mar 10, 2025