SvdH_-_RPLament-22B-gguf

RichardErkhov/SvdH_-_RPLament-22B-gguf

SvdH_-_RPLament-22B-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

Downloads · 30 days

1% of all-time downloads

All-time downloads

1.6K

Public

Repo size

223 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf262 GB · 100%

At a glance

Access: Public
Created: Oct 28, 2024
Updated: Oct 29, 2024
SHA: 2f79c4c6

Model card

From the Hugging Face model README

Quantization made by Richard Erkhov.

Github

Discord

Request more models

RPLament-22B - GGUF

Model creator: https://huggingface.co/SvdH/
Original model: https://huggingface.co/SvdH/RPLament-22B/

Name	Quant method	Size
RPLament-22B.Q2_K.gguf	Q2_K	7.7GB
RPLament-22B.Q3_K_S.gguf	Q3_K_S	8.98GB
RPLament-22B.Q3_K.gguf	Q3_K	10.02GB
RPLament-22B.Q3_K_M.gguf	Q3_K_M	10.02GB
RPLament-22B.Q3_K_L.gguf	Q3_K_L	10.92GB
RPLament-22B.IQ4_XS.gguf	IQ4_XS	11.22GB
RPLament-22B.Q4_0.gguf	Q4_0	11.71GB
RPLament-22B.IQ4_NL.gguf	IQ4_NL	11.83GB
RPLament-22B.Q4_K_S.gguf	Q4_K_S	11.79GB
RPLament-22B.Q4_K.gguf	Q4_K	12.43GB
RPLament-22B.Q4_K_M.gguf	Q4_K_M	12.43GB
RPLament-22B.Q4_1.gguf	Q4_1	12.99GB
RPLament-22B.Q5_0.gguf	Q5_0	14.27GB
RPLament-22B.Q5_K_S.gguf	Q5_K_S	14.27GB
RPLament-22B.Q5_K.gguf	Q5_K	14.64GB
RPLament-22B.Q5_K_M.gguf	Q5_K_M	14.64GB
RPLament-22B.Q5_1.gguf	Q5_1	15.56GB
RPLament-22B.Q6_K.gguf	Q6_K	17.0GB
RPLament-22B.Q8_0.gguf	Q8_0	22.02GB

Original model description:

base_model:

allura-org/MS-Meadowlark-22B
Gryphe/Pantheon-RP-1.6.2-22b-Small
ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1
rAIfle/Acolyte-22B
anthracite-org/magnum-v4-22b library_name: transformers tags:
mergekit
merge license: other license_name: mrl license_link: https://mistral.ai/licenses/MRL-0.1.md

RPLament-22B

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the DARE TIES merge method using ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1 as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

merge_method: dare_ties
base_model: ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1
parameters:
  int8_mask: true
dtype: bfloat16
models:
  - model: ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1
    parameters:
      weight: 0.30
      density: 0.78
  - model: anthracite-org/magnum-v4-22b
    parameters:
      weight: 0.25
      density: 0.66
  - model: allura-org/MS-Meadowlark-22B
    parameters:
      weight: 0.20
      density: 0.54
  - model: rAIfle/Acolyte-22B
    parameters:
      weight: 0.15
      density: 0.42
  - model: Gryphe/Pantheon-RP-1.6.2-22b-Small
    parameters:
      weight: 0.10
      density: 0.42

Created: Oct 28, 2024
Updated: Oct 29, 2024