Downloads · 30 days
14
11% of all-time downloads
Mixtral-Instruct-v0.2-2x7B-AWQ
solidrust/Mixtral-Instruct-v0.2-2x7B-AWQ
Mixtral-Instruct-v0.2-2x7B-AWQ is a text generation model from solidrust. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Mistral 7B Instruct v0.2 7B (with only 2 experts)
All-time downloads
122
Public
Parameters
12.9B
7.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors7.1 GB · 100%
Parameter types
How the weights are stored.
I3212.6B · 98%
Try a prompt
Base models
Model card
From the Hugging Face model README
perlthoughts/Mistral-7B-Instruct-v0.2-2x7B-MoE AWQ
Model Summary
Mistral 7B Instruct v0.2 7B (with only 2 experts)
The Mistral-7B-Instruct-v0.2 Large Language Model (LLM) is an improved instruct fine-tuned version of Mistral-7B-Instruct-v0.1.
For full details of this model please read our paper and release blog post.
Instruction format
In order to leverage instruction fine-tuning, your prompt should be surrounded by [INST] and [/INST] tokens. The very first instruction should begin with a begin of sentence id. The next instructions should not. The assistant generation will be ended by the end-of-sentence token id.
E.g.
text = "<s>[INST] What is your favourite condiment? [/INST]"
"Well, I'm quite partial to a good squeeze of fresh lemon juice. It adds just the right amount of zesty flavour to whatever I'm cooking up in the kitchen!</s> "
"[INST] Do you have mayonnaise recipes? [/INST]"
This format is available as a chat template via the apply_chat_template() method
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- apache-2.0
- Languages
- en
- Created
- Apr 17, 2024
- Updated
- Sep 3, 2024