jeffmeloy

WestLake-7B-v2.Q8_0.gguf

jeffmeloy/WestLake-7B-v2.Q8_0.gguf

WestLake-7B-v2.Q8_0.gguf is a machine learning model from jeffmeloy. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.

Quantized this https://huggingface.co/senseable/WestLake-7B-v2 using the config.json and tokenizerconfig.json parameters from this: https://huggingface.co/NurtureAI/OpenHermes-2.5-Mistral-7B-16k