Downloads · 30 days
19
7% of all-time downloads
TheBigBlender/Orca2myth7.2
Orca2myth7.2 is a text generation model from TheBigBlender. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
A product of an amateur merger. I like it due to the fact that it combines both Orca2 understanding and Pyg's dialogue style (using mythalion for consistency). - shotmisser64
Downloads · 30 days
19
7% of all-time downloads
All-time downloads
281
Public
Parameters
20B
40 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors40 GB · 100%
From the Hugging Face model README
A product of an amateur merger. I like it due to the fact that it combines both Orca2 understanding and Pyg's dialogue style (using mythalion for consistency). - shotmisser64
This model was made by ShotMisser64 using the following mergekit yaml:
slices:
- sources:
- model: output/Orca2flat
layer_range: [0, 13]
- sources:
- model: PygmalionAI/mythalion-13b
layer_range: [3, 22]
- sources:
- model: output/Orca2flat
layer_range: [14, 27]
- sources:
- model: PygmalionAI/mythalion-13b
layer_range: [23, 40]
merge_method: passthrough
dtype: float16
The Orca2flat model uses the following mergekit yaml:
merge_method: task_arithmetic
base_model: TheBloke/Llama-2-13B-fp16
models:
- model: TheBloke/Llama-2-13B-fp16
- model: microsoft/Orca-2-13b
parameters:
weight: 1.0
dtype: float16
Found something interesting or would you like your own custom merge? Visit our community at https://koboldai.org/discord
Please respect the license of the origin models.