Skip to content

zaq-hack

Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss-bpw300-h6-exl2

zaq-hack/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss-bpw300-h6-exl2

Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss-bpw300-h6-exl2 is a text generation model from zaq-hack. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.

EXL2 @ 3.00bpw</br The 3.64bpw fits into my 3090, but it is very crowded (and less than full context). This one fits with 32k context and a negative prompt cache. And it also works as well, for me, as the 4.50 bpw. I'…

Downloads · 30 days

7

2% of all-time downloads

All-time downloads

292

Public

Repo size

17.8 GB

Likes

2

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors17.8 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
cc-by-nc-4.0
Model type
mixtral
Access
Public
Created
Jan 17, 2024
Updated
Jan 17, 2024
SHA
30956b82

Try a prompt

Task
Text Generation
Library
transformers
Type
mixtral
License
cc-by-nc-4.0
Created
Jan 17, 2024
Updated
Jan 17, 2024