Downloads · 30 days
28
27% of all-time downloads
mixtral-dare-8x7b-v0
martyn/mixtral-dare-8x7b-v0
mixtral-dare-8x7b-v0 is a text generation model from martyn. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
The following were merged with DARE using https://github.com/martyn/safetensors-merge-supermario
All-time downloads
103
Public
Parameters
46.7B
93.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors93.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- mixtral
- Access
- Public
- Created
- Dec 19, 2023
- Updated
- Dec 19, 2023
- SHA
- 60ecc080
Try a prompt
Model card
From the Hugging Face model README
mixtral dare test
The following were merged with DARE using https://github.com/martyn/safetensors-merge-supermario
Mergelist
mistralai/Mixtral-8x7B-Instruct-v0.1
Open-Orca/Mixtral-SlimOrca-8x7B
Merge command
python3 hf_merge.py to_merge_mixtral0.txt mixtral-0 -p 0.3 -lambda 2.1
Notes
- This is primarily a test to see if merging mixtral models works.
- MoE gates are not merged.
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- mit
- Languages
- en
- Created
- Dec 19, 2023
- Updated
- Dec 19, 2023