reallad

lobollama

reallad/lobollama

lobollama is a text generation model from reallad. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.

A modified version of llama-2-7b with only 4 k-v heads. Outputs gibberish, but some functionality appears to be restorable through fine-tuning.