Merge-Mayhem-L3-V2.1

saishf/Merge-Mayhem-L3-V2.1

Merge-Mayhem-L3-V2.1 is a text generation model from saishf. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.

This is a merge of pre-trained language models created using mergekit.

Downloads · 30 days

1% of all-time downloads

All-time downloads

3.6K

Public

Parameters

16.1 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors16.1 GB · 100%

At a glance

Task: Text Generation
Library: transformers
License: cc-by-nc-4.0
Model type: llama
Access: Public
Created: May 9, 2024
Updated: May 9, 2024
SHA: ac3d3a0b

Try a prompt

Base models

Spaces

Model card

From the Hugging Face model README

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Rerun of V2 using Meta's repo and a possibly better config?

I'm unsure if the results will be much different, I don't know if model stock varies the mix much.

Merge Method

This model was merged using the Model Stock merge method using openlynn/Llama-3-Soliloquy-8B-v2 as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: meta-llama/Meta-Llama-3-8B-Instruct+ResplendentAI/Aura_Llama3
  - model: meta-llama/Meta-Llama-3-8B-Instruct+ResplendentAI/Smarts_Llama3
  - model: meta-llama/Meta-Llama-3-8B-Instruct+ResplendentAI/Luna_Llama3
  - model: meta-llama/Meta-Llama-3-8B-Instruct+ResplendentAI/BlueMoon_Llama3
  - model: meta-llama/Meta-Llama-3-8B-Instruct+ResplendentAI/RP_Format_QuoteAsterisk_Llama3
merge_method: model_stock
base_model: openlynn/Llama-3-Soliloquy-8B-v2
dtype: float16

Task: Text Generation
Library: transformers
Type: llama
License: cc-by-nc-4.0
Featherless Ai: live
Created: May 9, 2024
Updated: May 9, 2024