Downloads · 30 days
0
CRD716/ggml-vicuna-1.1-quantized
ggml-vicuna-1.1-quantized is a text generation model from CRD716. Use it when you need the model to write or continue text. It is set up for adapter-transformers. The card lists the license as gpl-3.0.
NOTE: DEPRECIATED, BETTER PEOPLE DO THIS FOR THE NEW VERSIONS NOW
Downloads · 30 days
0
Access
Public
Updated Sep 9, 2023
Repo size
277 GB
Likes
43
Public
Click a slice to open those files.
.bin230 GB · 100%
From the Hugging Face model README
NOTE: DEPRECIATED, BETTER PEOPLE DO THIS FOR THE NEW VERSIONS NOW
Legacy is for llama.cpp setups older than https://github.com/ggerganov/llama.cpp/pull/1508, the regular is faster but does not work on old versions.
This is a ggml version of vicuna 7b and 13b. This is the censored model, a similar 1.0 uncensored 13b model can be found at https://huggingface.co/eachadea/ggml-vicuna-13b-1.1.