wenqiglantz

LlamaGuard-7b-GGUF

wenqiglantz/LlamaGuard-7b-GGUF

LlamaGuard-7b-GGUF is a text generation model from wenqiglantz. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.

This is a quantized model for meta-llama/LlamaGuard-7b. Two quantization methods were used: - Q5KM: 5-bit, preserves most of the model's performance - Q4KM: 4-bit, smaller footprints and saves more memory