wenqiglantz

Mistral-7B-Instruct-v0.2-GGUF

wenqiglantz/Mistral-7B-Instruct-v0.2-GGUF

Mistral-7B-Instruct-v0.2-GGUF is a text generation model from wenqiglantz. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

This is a quantized model for mistralai/Mistral-7B-Instruct-v0.2. Two quantization methods were used: - Q5KM: 5-bit, recommended, low quality loss. - Q4KM: 4-bit, recommended, offers balanced quality.