Downloads · 30 days
9
2% of all-time downloads
Blue-Orchid-2x7b-AWQ
LoneStriker/Blue-Orchid-2x7b-AWQ
Blue-Orchid-2x7b-AWQ is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
429
Public
Parameters
12.9B
7.1 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors7.1 GB · 100%
Parameter types
How the weights are stored.
I3212.6B · 98%
Try a prompt
Model card
From the Hugging Face model README
Blue-Orchid-2x7b
GGUF: https://huggingface.co/nakodanei/Blue-Orchid-2x7b_GGUF
Roleplaying focused MoE Mistral model.
One expert is a merge of mostly RP models, the other is a merge of mostly storywriting models. So it should be good at both. The base model is SanjiWatsuki/Kunoichi-DPO-v2-7B.
- Expert 1 is a merge of LimaRP, Limamono, Noromaid 0.4 DPO and good-robot.
- Expert 2 is a merge of Erebus, Holodeck, Dans-AdventurousWinds-Mk2, Opus, Ashhwriter and good-robot.
Prompt template (LimaRP):
### Instruction:
{system prompt}
### Input:
User: {prompt}
### Response:
Character:
Alpaca prompt template should work fine too.
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- apache-2.0
- Created
- Feb 3, 2024
- Updated
- Feb 3, 2024