wenqiglantz

Mistral-7B-v0.1-GGUF

wenqiglantz/Mistral-7B-v0.1-GGUF

Mistral-7B-v0.1-GGUF is a text generation model from wenqiglantz. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

This is a quantized model for mistralai/Mistral-7B-v0.1. Two quantization methods were used: - Q5KM: 5-bit, preserves most of the model's performance - Q4KM: 4-bit, smaller footprints and saves more memory