alpindale

Mistral-7B-Instruct-v0.2-EETQ

alpindale/Mistral-7B-Instruct-v0.2-EETQ

Mistral-7B-Instruct-v0.2-EETQ is a text generation model from alpindale. Use it when you need the model to write or continue text. It is set up for transformers.

Model quantized using a modified EETQ repo. Currently working on decoupling its kernels from CUTLASS to make this a bit easier to use.