TransformerTales

llama-2-7b-8bit-nested

TransformerTales/llama-2-7b-8bit-nested

llama-2-7b-8bit-nested is a text generation model from TransformerTales. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.

I used Google Colab to quantize/nest the Llama 2 7B model. Should help out those who wish to use Llama 2 7B on a low-end computer. GPU is still recomended...