Gattaca_3B

jeiku/Gattaca_3B

Gattaca_3B is a text generation model from jeiku. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.

This is a merge of pre-trained language models created using mergekit.

Downloads · 30 days

25% of all-time downloads

All-time downloads

Public

Parameters

2.8B

5.6 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors5.6 GB · 100%

At a glance

Task: Text Generation
Library: transformers
License: other
Model type: stablelm_epoch
Access: Public
Created: Jan 19, 2024
Updated: Jan 20, 2024
SHA: c67ba085

Try a prompt

Base models

Datasets

Model card

From the Hugging Face model README

Mixed

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the DARE TIES merge method using jeiku/RocketHermesZephyrBoros_3B as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: jeiku/RocketHermesZephyrBoros_3B+jeiku/Bluemoon_cleaned_StableLM
    parameters:
      weight: 0.30
      density: 0.25
  - model: jeiku/RocketHermesZephyrBoros_3B+jeiku/Toxic_DPO_StableLM
    parameters:
      weight: 0.25
      density: 0.25
  - model: jeiku/RocketHermesZephyrBoros_3B+jeiku/Theory_of_Mind_RP_128_StableLM
    parameters:
      weight: 0.35
      density: 0.25
  - model: jeiku/RocketHermesZephyrBoros_3B+jeiku/No_Robots_Alpaca_StableLM
    parameters:
      weight: 0.25
      density: 0.25
  - model: jeiku/RocketHermesZephyrBoros_3B+jeiku/Everything_v3_128_StableLM
    parameters:
      weight: 0.5
      density: 0.5
  - model: jeiku/RocketHermesZephyrBoros_3B+jeiku/Gnosis_StableLM
    parameters:
      weight: 0.4
      density: 0.4
  - model: jeiku/RocketHermesZephyrBoros_3B+jeiku/Erotica_StableLM
    parameters:
      weight: 0.20
      density: 0.20
merge_method: dare_ties
base_model: jeiku/RocketHermesZephyrBoros_3B
parameters:
dtype: bfloat16

Task: Text Generation
Library: transformers
Type: stablelm_epoch
License: other
Languages: en
Created: Jan 19, 2024
Updated: Jan 20, 2024