Downloads · 30 days
15
6% of all-time downloads
DraftReasoner-2x7B-MoE-v0.1
yuuko-eth/DraftReasoner-2x7B-MoE-v0.1
DraftReasoner-2x7B-MoE-v0.1 is a text generation model from yuuko-eth. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as unknown.
Experimental 2-expert MoE merge using mlabonne/Marcoro14-7B-slerp as base.
All-time downloads
231
Public
Parameters
12.9B
25.8 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors25.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- unknown
- Model type
- mixtral
- Access
- Public
- Created
- Jan 17, 2024
- Updated
- Jan 17, 2024
- SHA
- cb8c04e1
Try a prompt
Model card
From the Hugging Face model README
DraftReasoner-2x7B-MoE-v0.1
Experimental 2-expert MoE merge using mlabonne/Marcoro14-7B-slerp as base.
- Marcoro14-7B-slerp as base.
- OpenHermes-2.5-Mistral-7B as model 0.
- WizardMath-7B-V1.1 as model 1.
Notes
Please evaluate before use in any application pipeline. Activation for Math part of the model would be 'math', 'reason', 'solve', 'count'.
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- unknown
- Created
- Jan 17, 2024
- Updated
- Jan 17, 2024