Skip to content

JayhC

Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss-4.5bpw-h6-exl2

JayhC/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss-4.5bpw-h6-exl2

Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss-4.5bpw-h6-exl2 is a text generation model from JayhC. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.

4.5bpw/h6 exl2 quantization of NeverSleep/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss using default exllamav2 calibration dataset, to fully use my 31gb VRAM (-1 cuz windows..).

Downloads · 30 days

9

14% of all-time downloads

All-time downloads

65

Public

Repo size

26.5 GB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors26.5 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
cc-by-nc-4.0
Model type
mixtral
Access
Public
Created
Mar 21, 2024
Updated
Mar 25, 2024
SHA
bcf84cc7

Try a prompt

Task
Text Generation
Library
transformers
Type
mixtral
License
cc-by-nc-4.0
Created
Mar 21, 2024
Updated
Mar 25, 2024