Downloads · 30 days
49
0% of all-time downloads
solar-megamerge-dare-10.7b-v1
martyn/solar-megamerge-dare-10.7b-v1
solar-megamerge-dare-10.7b-v1 is a text generation model from martyn. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
The following models were merged with DARE using https://github.com/martyn/safetensors-merge-supermario
All-time downloads
38.9K
Public
Parameters
10.7B
42.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors42.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Dec 31, 2023
- Updated
- Dec 31, 2023
- SHA
- c08c2041
Try a prompt
Model card
From the Hugging Face model README
solar megamerge 10.7b
The following models were merged with DARE using https://github.com/martyn/safetensors-merge-supermario
Mergelist
models:
- model: upstage/SOLAR-10.7B-v1.0
- model: upstage/SOLAR-10.7B-Instruct-v1.0
parameters:
weight: 0.20
density: 0.8
- model: kyujinpy/SOLAR-Platypus-10.7B-v1
parameters:
weight: 0.19
density: 0.75
- model: We-Want-GPU/SOLAR-10.7B-orca-alpaca-gpt4-math
parameters:
weight: 0.18
density: 0.75
- model: maywell/Synatra-10.7B-v0.4
parameters:
weight: 0.18
density: 0.7
- model: kyujinpy/SOLAR-Platypus-10.7B-v2
parameters:
weight: 0.17
density: 0.7
- model: Sao10K/Frostwind-10.7B-v1
parameters:
weight: 0.16
density: 0.65
- model: rishiraj/meow
parameters:
weight: 0.15
density: 0.6
Merge command
python3 hf_merge.py mergelist.yaml solar-1
Notes
- in the yaml:
p=weightandlambda=1/density
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Dec 31, 2023
- Updated
- Dec 31, 2023