Downloads · 30 days
11
2% of all-time downloads
YokaiKoibito/llama2_70b_chat_uncensored-fp16
llama2_70b_chat_uncensored-fp16 is a text generation model from YokaiKoibito. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
This is an fp16 copy of jarradh/llama270bchatuncensored for faster downloading and less disk space usage than the fp32 original. I simply imported the model to CPU with torchdtype=torch.float16 and then exported it ag…
Downloads · 30 days
11
2% of all-time downloads
All-time downloads
630
Public
Repo size
276 GB
Likes
2
Public
Click a slice to open those files.
.bin138 GB · 100%
From the Hugging Face model README
This is an fp16 copy of jarradh/llama2_70b_chat_uncensored for faster downloading and less disk space usage than the fp32 original. I simply imported the model to CPU with torch_dtype=torch.float16 and then exported it again. I also added a chat_template entry derived from the model card to the tokenizer_config.json file, which previously didn't have one. All credit for the model goes to jarradh.
Arguable a better name for this model would be something like Llama-2-70B_Wizard-Vicuna-Uncensored-fp16, but to avoid confusion I'm sticking with jarradh's naming scheme.
<!-- repositories-available start -->### HUMAN:
{prompt}
### RESPONSE: