Downloads · 30 days
43
3% of all-time downloads
Naphula/Cthulhu-70B-v1-GGUF
Cthulhu-70B-v1-GGUF is a machine learning model from Naphula. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as llama3.3.
[!CAUTION] <span style="color:red; font-weight:bold"⚠️ Warning:</span This model can produce narratives and RP that contain violent and graphic erotic content. Adjust your system prompt accordingly, and use Llama 3 ch…
Downloads · 30 days
43
3% of all-time downloads
All-time downloads
1.4K
Public
Repo size
124 GB
Likes
0
Public
Click a slice to open those files.
.gguf124 GB · 100%
From the Hugging Face model README
[!CAUTION] <span style="color:red; font-weight:bold">⚠️ Warning:</span> This model can produce narratives and RP that contain violent and graphic erotic content. Adjust your system prompt accordingly, and use Llama 3 chat template.
Only the Q4_0 is available for now. This runs faster than Q4_K_M with low VRAM.
Update: I have added a few more essential quants, mirrored from mradermacher: IQ4_XS, IQ3_XXS, IQ2_XXS
Team mradermacher has uploaded several more quants, so if you need them in other sizes go here:
https://huggingface.co/mradermacher/Cthulhu-70B-v1-GGUF
https://huggingface.co/mradermacher/Cthulhu-70B-v1-i1-GGUF
