yujiepan

llama-2-7b-w8a8-unstructured50

yujiepan/llama-2-7b-w8a8-unstructured50

llama-2-7b-w8a8-unstructured50 is a text generation model from yujiepan. Use it when you need the model to write or continue text. It is set up for transformers.

This model is w8a8 quantized & unstructually sparsified by OpenVINO, exported from meta-llama/Llama-2-7b-hf.