Downloads · 30 days
49
0% of all-time downloads
CleverMommy-mix-20b
athirdpath/CleverMommy-mix-20b
CleverMommy-mix-20b is a text generation model from athirdpath. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
An extended part of my effort to create Eileithyia-20B. This model is made by following the recipe below, inverting it, then SLERPing the models back together at 0.5, hopefully fusing the models into one block for use…
All-time downloads
30.6K
Public
Parameters
20B
40 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors40 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- llama
- Access
- Public
- Created
- Nov 26, 2023
- Updated
- Nov 26, 2023
- SHA
- 701714a3
Try a prompt
Model card
From the Hugging Face model README
An extended part of my effort to create Eileithyia-20B. This model is made by following the recipe below, inverting it, then SLERPing the models back together at 0.5, hopefully fusing the models into one block for use with Harmonia.
slices:
- sources:
- model: microsoft/Orca-2-13b
- layer_range: [0, 16]
- sources:
- model: athirdpath/Eileithyia-13B
- layer_range: [8, 24]
- sources:
- model: microsoft/Orca-2-13b
- layer_range: [17, 32]
- sources:
- model: athirdpath/Eileithyia-13B
- layer_range: [25, 40]
merge_method: passthrough
dtype: float16
Thanks to Undi95 for pioneering the recipe.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- cc-by-nc-4.0
- Created
- Nov 26, 2023
- Updated
- Nov 26, 2023