Downloads · 30 days
69
0% of all-time downloads
mixtral-megamerge-dare-8x7b-v1
martyn/mixtral-megamerge-dare-8x7b-v1
mixtral-megamerge-dare-8x7b-v1 is a text generation model from martyn. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
The following models were merged with DARE using https://github.com/martyn/safetensors-merge-supermario
All-time downloads
32.3K
Public
Repo size
93.4 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors93.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mixtral
- Access
- Public
- Created
- Dec 24, 2023
- Updated
- Dec 24, 2023
- SHA
- b17a63f6
Try a prompt
Model card
From the Hugging Face model README
mixtral megamerge 8x7b v1
The following models were merged with DARE using https://github.com/martyn/safetensors-merge-supermario
Mergelist
cognitivecomputations/dolphin-2.6-mixtral-8x7b
mistralai/Mixtral-8x7B-v0.1
mistralai/Mixtral-8x7B-Instruct-v0.1
Merge command
python hf_merge.py mergelist.txt mixtral-merge-1 -p 0.1 -lambda 1.95
Notes
- seems to generalize instruct styles
- MoE gates are not modified
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- apache-2.0
- Languages
- en
- Created
- Dec 24, 2023
- Updated
- Dec 24, 2023