Skip to content

benk04

Typhon-Mixtral-v1-3.75bpw-h6-exl2

benk04/Typhon-Mixtral-v1-3.75bpw-h6-exl2

Typhon-Mixtral-v1-3.75bpw-h6-exl2 is a text generation model from benk04. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.

Exllamav2 3.75bpw quantization of Typhon-Mixtral-v1 from Sao10K, quantized with default calibration dataset. [!IMPORTANT] This bpw is the perfect size for 24GB GPUs, and can fit 32k context. Make sure to enable 4-bit…

Downloads · 30 days

16

15% of all-time downloads

All-time downloads

108

Public

Repo size

22.1 GB

Likes

3

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors22.1 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
cc-by-nc-4.0
Model type
mixtral
Access
Public
Created
Jun 2, 2024
Updated
Jun 2, 2024
SHA
89b150e1

Try a prompt

Base models

Task
Text Generation
Library
transformers
Type
mixtral
License
cc-by-nc-4.0
Languages
en
Created
Jun 2, 2024
Updated
Jun 2, 2024