blueprintninja

llama-3.2-3B-Instruct-GGUF-Q4_0-NONAVX

blueprintninja/llama-3.2-3B-Instruct-GGUF-Q4_0-NONAVX

llama-3.2-3B-Instruct-GGUF-Q4_0-NONAVX is a machine learning model from blueprintninja. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

llamafile lets you distribute and run LLMs with a single file. announcement blog post