Downloads · 30 days
13
45% of all-time downloads
Mistral-7B-OpenOrca-exl2
turboderp/Mistral-7B-OpenOrca-exl2
Mistral-7B-OpenOrca-exl2 is a machine learning model from turboderp. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
29
Public
Repo size
53.6 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.json1.8 MB · 100%
At a glance
- Access
- Public
- Created
- Oct 6, 2023
- Updated
- Dec 28, 2023
- SHA
- d5129f12
Model card
From the Hugging Face model README
EXL2 quants of Mistral-7B-OpenOrca
Converted from Mistral-7B-OpenOrca. This is a
straight conversion, but I have modified the config.json to make the default context size 7168 tokens, since in
initial testing the model becomes unstable a while after that. It's possible that sliding window attention will
allow the model to use its advertised 32k-token context, but this hasn't been tested yet.
2.50 bits per weight
2.70 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
- Created
- Oct 6, 2023
- Updated
- Dec 28, 2023