Downloads · 30 days
41
31% of all-time downloads
Harmonia-20b-GGUF
athirdpath/Harmonia-20b-GGUF
Harmonia-20b-GGUF is a machine learning model from athirdpath. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-4.0.
These are fp16, q80, q5km, and q4km GGUF quants of Harmonia-20B.
All-time downloads
132
Public
Repo size
87.4 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf87.4 GB · 100%
At a glance
- License
- cc-by-nc-4.0
- Access
- Public
- Created
- Nov 25, 2023
- Updated
- Nov 27, 2023
- SHA
- da29da76
Model card
From the Hugging Face model README
Description
These are fp16, q_8_0, q5_k_m, and q4_k_m GGUF quants of Harmonia-20B.
Harmonia-20B is a unified 20B model crafted via a multi-step SLERP merge of eight 20B models. The aim was to develop a versatile "base model" for TaskArithmetic in this size class.
Merging Process:
Models:
- model: Undi95/Emerhyst-20B
- model: Undi95/MXLewd-L2-20B
- model: Undi95/Lewd-Sydney-20B
- model: athirdpath/Nethena-20b-Glued
- model: tavtav/Rose-20B
- model: Undi95/PsyMedRP-v1-20B
- model: NeverSleep/Noromaid-20b-v0.1.1
- model: Undi95/U-Amethyst-20B
Concept:
The idea behind this process was to blend the unique attributes of each model while minimizing individual quirks. This approach has also shown promising results as a standalone RP model, providing a combination of high-quality writing and situational problem-solving/awareness.
Prompt template: Alpaca
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Response:
Thanks to Undi95 for pioneering the 20B recipe, and for most of the models involved.
- License
- cc-by-nc-4.0
- Created
- Nov 25, 2023
- Updated
- Nov 27, 2023