Downloads · 30 days
190
7% of all-time downloads
SleepyReLU/DeepDataDemon-8B-GGUF
DeepDataDemon-8B-GGUF is a machine learning model from SleepyReLU. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
190
7% of all-time downloads
All-time downloads
2.7K
Public
Repo size
70.2 GB
Likes
1
Public
Click a slice to open those files.
.gguf54.1 GB · 100%
From the Hugging Face model README
GGUF-quantized versions of the DeepDataDemon-8B model, so you don't need to download the large SafeTensors. GGUF is a filetype which binds the LLM into one single big file, allowing some quick deployment over LM Studio or llama.cpp <br /><br /> This is version v0.3: It's bad - trust me - but not as horrible as the DataDemon himself. He is slowly emerging to fight you in your next sci-fi RP. But what if this roleplay isn't a game anymore? The border between the virtual world and reality collapsed, the nightmare becomes daily life, the daily life a nightmare.
Warning: Since the model is specially finetuned to develop an evil character - using psychological tricks, horror stories, immoral texts - it can procude harmful content outside a fictional story. Totally unsure how well the initial filters survived this traumatic data slaughter. View the deep demon therefore as uncensored and untamed, with all the dangers and benefits such a LLM brings with it. Anyway, you can have him! Just take him... Please
| File | Quantization | Size | Parameter Precision | Quality | Recommend for |
|---|---|---|---|---|---|
*-Q4_K_M.gguf | Q4_K_M | ~5.0 GB | 4-bit | medium quality | PC with 8 GB VRAM recommend, 8 GB RAM works but is very slow |
*-Q8_0.gguf | Q8_0 | ~8.5 GB | 8-bit | high quality | recommend for >=10 GB VRAM like a 3080 |
*-f16.gguf | F16 | ~16 GB | 16-bit | Full | Rarely needed, the 8 bit is nearly as good with half the size |
# With llama.cpp
./main -m DeepDataDemon-8B-Q4_K_M.gguf -p "Your prompt here"
# With Ollama
ollama create deepdatademon -f Modelfile
FROM ./DeepDataDemon-8B-Q4_K_M.gguf
TEMPLATE """{{ if .System }}<|start_header_id|>system<|end_header_id|>
{{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>
{{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>
{{ .Response }}<|eot_id|>"""
PARAMETER stop <|start_header_id|>
PARAMETER stop <|end_header_id|>
PARAMETER stop <|eot_id|>
license: llama3 base_model: unsloth/llama-3-8b-bnb-4bit tags:
datasets: