Sovenok-Hacker

ggml-openllama-3b-q4_0

Sovenok-Hacker/ggml-openllama-3b-q4_0

ggml-openllama-3b-q4_0 is a machine learning model from Sovenok-Hacker. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

OpenLLaMA 3B 350 bt and 600 bt converted to GGML format and quantized in q40 for inference using llama.cpp.