Downloads · 30 days
74
10% of all-time downloads
Hack337/WavGPT-1.5-GGUF
WavGPT-1.5-GGUF is a text generation model from Hack337. Use it when you need the model to write or continue text. The card lists the license as other.
Check out our llama.cpp documentation for more usage guide.
Downloads · 30 days
74
10% of all-time downloads
All-time downloads
733
Public
Repo size
5 GB
Likes
2
Public
Click a slice to open those files.
.gguf5 GB · 100%
From the Hugging Face model README
Check out our llama.cpp documentation for more usage guide.
We advise you to clone llama.cpp and install it following the official guide. We follow the latest version of llama.cpp.
In the following demonstration, we assume that you are running commands under the repository llama.cpp.
Since cloning the entire repo may be inefficient, you can manually download the GGUF file that you need or use huggingface-cli:
pip install -U huggingface_hub
huggingface-cli download Hack337/WavGPT-1.5-GGUF WavGPT-1.5.gguf --local-dir . --local-dir-use-symlinks False
For users, to achieve chatbot-like experience, it is recommended to commence in the conversation mode:
./llama-cli -m <gguf-file-path> \
-co -cnv -p "Вы очень полезный помощник." \
-fa -ngl 80 -n 512