Skip to content

Chronal

Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss_attn-4bit-moe-2bit-metaoffload-HQQ

Chronal/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss_attn-4bit-moe-2bit-metaoffload-HQQ

Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss_attn-4bit-moe-2bit-metaoffload-HQQ is a text generation model from Chronal. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.

This is another HQQ Quantization of Noromaid Mixtral, the same as ProphetOfBostrom's earlier work but with Metadata Offloading enabled, which wasn't available when they made their quant.

Downloads · 30 days

8

9% of all-time downloads

All-time downloads

90

Public

Repo size

24.1 GB

Likes

1

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.pt24.1 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
cc-by-nc-4.0
Model type
mixtral
Access
Public
Created
Apr 15, 2024
Updated
Apr 15, 2024
SHA
ad9d5a55

Try a prompt

Task
Text Generation
Library
transformers
Type
mixtral
License
cc-by-nc-4.0
Created
Apr 15, 2024
Updated
Apr 15, 2024