Skip to content

mobiuslabsgmbh

Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ

mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ

Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ is a text generation model from mobiuslabsgmbh. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

This is a version of the <a href="https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1" Mixtral-8x7B-Instruct-v0.1 model</a quantized with a mix of 4-bit and 2-bit via Half-Quadratic Quantization (HQQ). More sp…

Downloads · 30 days

71

7% of all-time downloads

All-time downloads

1.1K

Public

Repo size

36.7 GB

Likes

16

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.pt18.3 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
apache-2.0
Model type
mixtral
Access
Public
Created
Feb 23, 2024
Updated
Feb 5, 2025
SHA
459418cf

Try a prompt

Task
Text Generation
Library
transformers
Type
mixtral
License
apache-2.0
Created
Feb 23, 2024
Updated
Feb 5, 2025