Downloads · 30 days
9
16% of all-time downloads
LoneStriker/Mistral-11B-CC-Air-4.0bpw-h6-exl2
Mistral-11B-CC-Air-4.0bpw-h6-exl2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
CollectiveCognition-v1.1-Mistral-7B and airoboros-mistral2.2-7b glued together.
Downloads · 30 days
9
16% of all-time downloads
All-time downloads
55
Public
Repo size
5.6 GB
Likes
0
Public
Click a slice to open those files.
.safetensors5.6 GB · 100%
From the Hugging Face model README
CollectiveCognition-v1.1-Mistral-7B and airoboros-mistral2.2-7b glued together.
<!-- description start -->This repo contains fp16 files of Mistral-11B-CC-Air.
<!-- description end --> <!-- description start -->Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Response:
USER: <prompt>
ASSISTANT:
slices:
- sources:
- model: teknium/CollectiveCognition-v1.1-Mistral-7B
layer_range: [0, 24]
- sources:
- model: teknium/airoboros-mistral2.2-7b
layer_range: [8, 32]
merge_method: passthrough
dtype: float16
Special thanks to Sushi.
If you want to support me, you can here.