Downloads · 30 days
1.1K
15% of all-time downloads
YokaiKoibito/llama2_70b_chat_uncensored-GGUF
llama2_70b_chat_uncensored-GGUF is a machine learning model from YokaiKoibito. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama2.
This is an GGUF version of jarradh/llama270bchatuncensored
Downloads · 30 days
1.1K
15% of all-time downloads
All-time downloads
7.7K
Public
Repo size
573 GB
Likes
4
Public
Click a slice to open those files.
.gguf305 GB · 53%
From the Hugging Face model README
This is an GGUF version of jarradh/llama2_70b_chat_uncensored
(Arguable a better name for this model would be something like Llama-2-70B_Wizard-Vicuna-Uncensored-GGUF, but to avoid confusion I'm sticking with jarradh's naming scheme.)
<!-- README_GGUF.md-about-gguf start -->GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
The key benefit of GGUF is that it is a extensible, future-proof format which stores more information about the model as metadata. It also includes significantly improved tokenization code, including for the first time full support for special tokens. This should improve performance, especially with models that use new special tokens and implement custom prompt templates.
As of August 25th, here is a list of clients and libraries that are known to support GGUF:
c_transformers backend. A great web UI with many interesting features. Supports CUDA GPU acceleration.The clients and libraries below are expecting to add GGUF support shortly:
<!-- README_GGUF.md-about-gguf end --> <!-- repositories-available start -->### HUMAN:
{prompt}
### RESPONSE: