Sherstnev

llama-30b-awq-w4

Sherstnev/llama-30b-awq-w4

llama-30b-awq-w4 is a text generation model from Sherstnev. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.

This model was quantized with AWQ algorithm. Intended to use with lmdeploy package.