Downloads · 30 days
5
8% of all-time downloads
RichardErkhov/Nondzu_-_zephyr-speakleash-010-pl-3072-32-16-0.01-4bits
Nondzu_-_zephyr-speakleash-010-pl-3072-32-16-0.01-4bits is a text generation model from RichardErkhov. Use it when you need the model to write or continue text. It is set up for transformers.
Downloads · 30 days
5
8% of all-time downloads
All-time downloads
62
Public
Parameters
7.4B
4.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors4.5 GB · 100%
How the weights are stored.
U87B · 95%
From the Hugging Face model README
Quantization made by Richard Erkhov.
zephyr-speakleash-010-pl-3072-32-16-0.01 - bnb 4bits
<|im_start|>system
{system_message}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant