bartowski

bigstral-12b-32k-8xMoE-GGUF

bartowski/bigstral-12b-32k-8xMoE-GGUF

bigstral-12b-32k-8xMoE-GGUF is a text generation model from bartowski. Use it when you need the model to write or continue text. It is set up for transformers.

Using <a href="https://github.com/ggerganov/llama.cpp/"llama.cpp</a release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b2354"b2354</a for quantization.