Downloads · 30 days
11
4% of all-time downloads
Mixmistral-2x7b-4bit-bitsnbytes
uisikdag/Mixmistral-2x7b-4bit-bitsnbytes
Mixmistral-2x7b-4bit-bitsnbytes is a text generation model from uisikdag. Use it when you need the model to write or continue text. It is set up for transformers.
All-time downloads
258
Public
Parameters
13.1B
29 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8.1 GB · 100%
Parameter types
How the weights are stored.
U812.6B · 96%
Try a prompt
Model card
From the Hugging Face model README
Model Card for Model ID
prepared with mergekit
quantized with bitsandbytes 4q_k_m
config.yaml
base_model: mistralai/Mistral-7B-Instruct-v0.2
dtype: float16
gate_mode: cheap_embed
experts:
- source_model: HuggingFaceH4/zephyr-7b-beta
positive_prompts: ["You are an helpful general-pupose assistant."]
- source_model: mistralai/Mistral-7B-Instruct-v0.2
positive_prompts: ["You are helpful assistant."]
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- Created
- Mar 12, 2024
- Updated
- Mar 13, 2024