Downloads · 30 days
0
RachidAR/WizardLM-Uncensored-SCOT-StoryTelling-30B-Q2_K-GGML
WizardLM-Uncensored-SCOT-StoryTelling-30B-Q2_K-GGML is a machine learning model from RachidAR. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
These files are GGML format model files for Monero's WizardLM-Uncensored-SuperCOT-Storytelling-30B.
Downloads · 30 days
0
Access
Public
Updated Jun 6, 2023
Repo size
13.7 GB
Likes
5
Public
Click a slice to open those files.
.bin13.7 GB · 100%
From the Hugging Face model README
These files are GGML format model files for Monero's WizardLM-Uncensored-SuperCOT-Storytelling-30B.
Optional instruction ("You are a helpful assistant" etc)
USER: prompt
ASSISTANT:
This 2 bit model can run with 16 GB of RAM. On my Xeon E3-1225 v3 4/8 old cpu, it runs with ~660 ms per token.