Downloads · 30 days
6
11% of all-time downloads
RichardErkhov/Nondzu_-_zephyr-speakleash-010-pl-3072-32-16-0.01-8bits
Nondzu_-_zephyr-speakleash-010-pl-3072-32-16-0.01-8bits is a text generation model from RichardErkhov. Use it when you need the model to write or continue text. It is set up for transformers.
Downloads · 30 days
6
11% of all-time downloads
All-time downloads
54
Public
Parameters
7.2B
7.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors7.5 GB · 100%
How the weights are stored.
I87B · 96%
From the Hugging Face model README
Quantization made by Richard Erkhov.
zephyr-speakleash-010-pl-3072-32-16-0.01 - bnb 8bits
<|im_start|>system
{system_message}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant