Downloads · 30 days
9
14% of all-time downloads
JayhC/Noromaid-v0.1-mixtral-8x7b-Instruct-v3-4.5bpw-h6-exl2
Noromaid-v0.1-mixtral-8x7b-Instruct-v3-4.5bpw-h6-exl2 is a text generation model from JayhC. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
4.5bpw/h6 exl2 quantization of NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3 using default exllamav2 calibration dataset, to fully use my 31gb VRAM (-1 cuz windows..).
Downloads · 30 days
9
14% of all-time downloads
All-time downloads
66
Public
Repo size
26.5 GB
Likes
0
Public
Click a slice to open those files.
.safetensors26.5 GB · 100%
From the Hugging Face model README
4.5bpw/h6 exl2 quantization of NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3 using default exllamav2 calibration dataset, to fully use my 31gb VRAM (-1 cuz windows..).
ORIGINAL CARD:

This model uses the Alpaca prompting format(or just directly download the SillyTavern instruct preset here)
Beeg noromaid on steroids. Suitable for RP, ERP.
This time based on Mixtral Instruct, seems to do wonders!
This model was trained for 8h(v1) + 8h(v2) + 12h(v3) on customized modified datasets, focusing on RP, uncensoring, and a modified version of the Alpaca prompting (that was already used in LimaRP), which should be at the same conversational level as ChatLM or Llama2-Chat without adding any additional special tokens.
If you wanna have more infos about this model(and v1 + v2) you can check out my blog post
Recommended settings - Settings 1
Recommended settings - Settings 2 (idk if they are any good)
This repo contains FP16 files of Noromaid-v0.1-mixtral-8x7b-Instruct-v3.
<!-- [GGUF - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GGUF)--> <!-- [GPTQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GPTQ)--> <!-- [exl2[8bpw-8h] - by AzureBlack](https://huggingface.co/AzureBlack/Echidna-13b-v0.3-8bpw-8h-exl2)--> <!-- [AWQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-AWQ)--> <!-- [fp16 - by IkariDev+Undi95](https://huggingface.co/IkariDev/Athena-v4)--> <!-- [OLD(GGUF - by IkariDev+Undi95)](https://huggingface.co/IkariDev/Athena-v4-GGUF)-->Note: We have permission of all users to upload their ratings, we DONT screenshot random reviews without asking if we can put them here!
No ratings yet!
If you want your rating to be here, send us a message over on DC and we'll put up a screenshot of it here. DC name is "ikaridev" and "undi".
<!-- description end --> <!-- prompt-template start -->### Instruction:
{system prompt}
### Input:
{input}
### Response:
{reply}
Undi: If you want to support me, you can here.
IkariDev: Visit my retro/neocities style website please kek