patrickbdevaney

llama-2-7b-minguanaco-google-colab-test

patrickbdevaney/llama-2-7b-minguanaco-google-colab-test

llama-2-7b-minguanaco-google-colab-test is a text generation model from patrickbdevaney. Use it when you need the model to write or continue text. It is set up for transformers.

Brief note: trained locally on Windows. Bits and Bytes and PEFT were not working so I fine tuned a smaller 1b model without quantization. Later I switched to Ubuntu and got qlora and peft working, then fine tuned 7b