Downloads · 30 days
6
13% of all-time downloads
dev137/Weyaxi_Bagel-Hermes-2x34b-exl2-2.0bpw-h8
Weyaxi_Bagel-Hermes-2x34b-exl2-2.0bpw-h8 is a text generation model from dev137. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Downloads · 30 days
6
13% of all-time downloads
All-time downloads
46
Public
Repo size
18 GB
Likes
0
Public
Click a slice to open those files.
.safetensors18 GB · 100%
From the Hugging Face model README

This is the model for Bagel-Hermes-2x34B. I used mergekit to make this MOE model.
Since bagel-dpo-34b-v0.2 uses many prompt templates, and Nous-Hermes-2-Yi-34B uses ChatML, you can utilize ChatML and other prompt templates provided by bagel.
Note: I currently do not know which prompt template is best.
<|im_start|>system
{system}<|im_end|>
<|im_start|>user
{user}<|im_end|>
<|im_start|>assistant
{asistant}<|im_end|>
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{system}
{instruction}
### Response:
{system}
USER: {instruction}
ASSISTANT:
Visit bagel-dpo-34b-v0.2 to try more prompt templates.
base_model: nontoxic-bagel-34b-v0.2
gate_mode: hidden
dtype: bfloat16
experts:
- source_model: bagel-dpo-34b-v0.2
positive_prompts: ["question answering", "Q:", science", "biology", "chemistry", "physics"]
- source_model: Nous-Hermes-2-Yi-34B
positive_prompts: ["chat", "math", "reason", "mathematics", "solve", "count", "python", "javascript", "programming", "algorithm", "tell me", "assistant"]
Quantizationed versions of this model is available thanks to TheBloke.
If you would like to support me: