Skip to content

mobiuslabsgmbh

Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-HQQ

mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-HQQ

Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-HQQ is a text generation model from mobiuslabsgmbh. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

This is a version of the Mixtral-8x7B-Instruct-v0.1 model (https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1) quantized with a mix of 4-bit and 2-bit via Half-Quadratic Quantization (HQQ).

Downloads · 30 days

89

8% of all-time downloads

All-time downloads

1.1K

Public

Repo size

18.2 GB

Likes

38

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.pt18.2 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
apache-2.0
Model type
mixtral
Access
Public
Created
Dec 15, 2023
Updated
Feb 5, 2025
SHA
de8c19e0

Try a prompt

Task
Text Generation
Library
transformers
Type
mixtral
License
apache-2.0
Created
Dec 15, 2023
Updated
Feb 5, 2025