Smort_3B

jeiku/Smort_3B

Smort_3B is a text generation model from jeiku. Use it when you need the model to write or continue text. It is set up for transformers.

This is a merge of pre-trained language models created using mergekit.

Downloads · 30 days

4% of all-time downloads

All-time downloads

367

Public

Parameters

2.8B

5.6 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors5.6 GB · 100%

At a glance

Task: Text Generation
Library: transformers
Model type: stablelm_epoch
Access: Public
Created: Jan 20, 2024
Updated: Jan 20, 2024
SHA: 462a419d

Try a prompt

Base models

Model card

From the Hugging Face model README

Mixed

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the linear merge method.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: jeiku/Linear_Base_3B+jeiku/Everything_v3_128_StableLM
    parameters:
      weight: 1.0
  - model: jeiku/Linear_Base_3B+jeiku/Theory_of_Mind_128_StableLM
    parameters:
      weight: 1.0
  - model: jeiku/Linear_Base_3B+jeiku/Toxic_DPO_StableLM
    parameters:
      weight: 1.0
  - model: jeiku/Linear_Base_3B+jeiku/No_Robots_Alpaca_StableLM
    parameters:
      weight: 1.0
  - model: jeiku/Linear_Base_3B+jeiku/Gnosis_StableLM
    parameters:
      weight: 1.0
merge_method: linear
dtype: float16

Task: Text Generation
Library: transformers
Type: stablelm_epoch
Created: Jan 20, 2024
Updated: Jan 20, 2024