wcde

llama-7b-4bit-act

wcde/llama-7b-4bit-act

llama-7b-4bit-act is a text generation model from wcde. Use it when you need the model to write or continue text. It is set up for transformers.

Generated with: --wbits 4 --act-order --true-sequential --new-eval --faster-kernel