brucethemoose

functionary-7b-v1-Q8_0

brucethemoose/functionary-7b-v1-Q8_0

functionary-7b-v1-Q8_0 is a machine learning model from brucethemoose. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama2.

Just high-bpw quantization of functionary for a drop-in OpenAI function calling replacement. See the llama-cpp-python docs: