Yi-34B-200K-RPMerge-exl2-267bpw

brucethemoose/Yi-34B-200K-RPMerge-exl2-267bpw

Yi-34B-200K-RPMerge-exl2-267bpw is a text generation model from brucethemoose. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.

Downloads · 30 days

3% of all-time downloads

All-time downloads

275

Public

Repo size

12.5 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors12.5 GB · 100%

At a glance

Task: Text Generation
Library: transformers
License: other
Model type: llama
Access: Public
Created: Feb 11, 2024
Updated: Feb 12, 2024
SHA: 42697ad7

Try a prompt

Model card

From the Hugging Face model README

RPmerge

2.67

See the main model card: https://huggingface.co/brucethemoose/Yi-34B-200K-RPMerge

Merge Details

Merge Method

This model was merged using the DARE TIES merge method using /home/alpha/Models/Raw/chargoddard_Yi-34B-200K-Llama as a base.

Models Merged

The following models were included in the merge:

/home/alpha/Models/Raw/migtissera_Tess-34B-v1.5b
/home/alpha/Models/Raw/migtissera_Tess-M-Creative-v1.0
/home/alpha/Models/Raw/cgato_Thespis-34b-DPO-v0.7
/home/alpha/Models/Raw/Nous-Capybara-34B
/home/alpha/Models/Raw/admo_limarp
/home/alpha/Models/Raw/DrNicefellow_ChatAllInOne-Yi-34B-200K-V1

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: /home/alpha/Models/Raw/chargoddard_Yi-34B-200K-Llama
    # No parameters necessary for base model
  - model: /home/alpha/Models/Raw/migtissera_Tess-34B-v1.5b
    #Emphasize the beginning of Vicuna format models
    parameters:
      weight: 0.19
      density: 0.59
  - model: /home/alpha/Models/Raw/Nous-Capybara-34B
    parameters:
      weight: 0.19
      density: 0.55
  # Vicuna format
  - model: /home/alpha/Models/Raw/migtissera_Tess-M-Creative-v1.0
    parameters:
      weight: 0.05
      density: 0.55
  - model: /home/alpha/Models/Raw/DrNicefellow_ChatAllInOne-Yi-34B-200K-V1
    parameters:
      weight: 0.19
      density: 0.55
  - model: /home/alpha/Models/Raw/admo_limarp
    parameters:
      weight: 0.19
      density: 0.48
  - model: /home/alpha/Models/Raw/cgato_Thespis-34b-DPO-v0.7
    parameters:
      weight: 0.19
      density: 0.59


merge_method: dare_ties
tokenizer_source: union
base_model: /home/alpha/Models/Raw/chargoddard_Yi-34B-200K-Llama
parameters:
  int8_mask: true
dtype: bfloat16

Task: Text Generation
Library: transformers
Type: llama
License: other
Languages: en
Created: Feb 11, 2024
Updated: Feb 12, 2024