ikawrakow

various-2bit-sota-gguf

ikawrakow/various-2bit-sota-gguf

various-2bit-sota-gguf is a machine learning model from ikawrakow. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.

Various models in GGUF format quantized with a new 2-bit approach. Intended for use with llama.cpp. Requires llama.cpp PR 4773.