grimjim

Mistral-7B-Instruct-v0.2-8bit-abliterated

grimjim/Mistral-7B-Instruct-v0.2-8bit-abliterated

Mistral-7B-Instruct-v0.2-8bit-abliterated is a text generation model from grimjim. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

This model was abliterated by computing a refusal vector an 8-bit bitsandbytes quant, and then applying the vector to the full weight model. Abliteration was performed locally using a CUDA GPU, the VRAM memory consump…