krakenalt

saiga2_70b_gguf

krakenalt/saiga2_70b_gguf

saiga2_70b_gguf is a machine learning model from krakenalt. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

Llama.cpp compatible versions of an original 70B model. Quantization q5km of model: saiga270b Download interactllamacpp.py