Skip to content

mobiuslabsgmbh

Mixtral-8x7B-Instruct-v0.1-hf-2bit_g16_s128-HQQ

mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-2bit_g16_s128-HQQ

Mixtral-8x7B-Instruct-v0.1-hf-2bit_g16_s128-HQQ is a text generation model from mobiuslabsgmbh. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

This is a version of the Mixtral-8x7B-Instruct-v0.1 model (https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1) quantized to 2-bit via Half-Quadratic Quantization (HQQ). To run the model, install the HQQ library:

Downloads · 30 days

14

2% of all-time downloads

All-time downloads

775

Public

Repo size

18 GB

Likes

9

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.pt18 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
apache-2.0
Model type
mixtral
Access
Public
Created
Dec 11, 2023
Updated
Feb 5, 2025
SHA
9642844a

Try a prompt

Task
Text Generation
Library
transformers
Type
mixtral
License
apache-2.0
Created
Dec 11, 2023
Updated
Feb 5, 2025