Downloads · 30 days
0
CleverMommy-mix-20b-GGUF
athirdpath/CleverMommy-mix-20b-GGUF
CleverMommy-mix-20b-GGUF is a machine learning model from athirdpath. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-4.0.
GGUF quants from extended part of my effort to create Eileithyia-20B. This model is made by following the recipe below, inverting it, then SLERPing the models back together at 0.5, hopefully fusing the models into one…
Access
Public
Updated Nov 26, 2023
Repo size
47.4 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin47.4 GB · 100%
At a glance
- License
- cc-by-nc-4.0
- Access
- Public
- Created
- Nov 26, 2023
- Updated
- Nov 26, 2023
- SHA
- 8a8301e7
Model card
From the Hugging Face model README
GGUF quants from extended part of my effort to create Eileithyia-20B. This model is made by following the recipe below, inverting it, then SLERPing the models back together at 0.5, hopefully fusing the models into one block for use with Harmonia.
slices:
- sources:
- model: microsoft/Orca-2-13b
- layer_range: [0, 16]
- sources:
- model: athirdpath/Eileithyia-13B
- layer_range: [8, 24]
- sources:
- model: microsoft/Orca-2-13b
- layer_range: [17, 32]
- sources:
- model: athirdpath/Eileithyia-13B
- layer_range: [25, 40]
merge_method: passthrough
dtype: float16
Thanks to Undi95 for pioneering the recipe.
- License
- cc-by-nc-4.0
- Created
- Nov 26, 2023
- Updated
- Nov 26, 2023