Downloads · 30 days
103
15% of all-time downloads
Stabhappy/Qwopus-3.5-27B-V3-Stabbed-GGUF
Qwopus-3.5-27B-V3-Stabbed-GGUF is a machine learning model from Stabhappy. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
Quantized GGUF files for Stabhappy/Qwopus-3.5-27B-V3-Stabbed.
Downloads · 30 days
103
15% of all-time downloads
All-time downloads
699
Public
Repo size
86.5 GB
Likes
0
Public
Click a slice to open those files.
.gguf86.5 GB · 100%
From the Hugging Face model README
Quantized GGUF files for Stabhappy/Qwopus-3.5-27B-V3-Stabbed.
This model is for research and educational purposes only. It is trained on a dataset that includes profanity, slurs, and edgy internet culture. It is not intended to be used as a production system, and its only current value is entertainment.
However, care has been taken to retain the model's original capabilities for long-horizon or complex requests.
This model will likely underperform when benchmarked against the base model.
| Format | Use Case |
|---|---|
Q8_0 | Near-lossless, good balance of quality and size |
Q6_K | High quality with moderate compression |
Q5_K_M | Good quality with stronger compression |
Q4_K_M | Maximum compression, acceptable quality loss |
Compatible with llama.cpp and any GGUF-compatible inference engine (e.g., LM Studio, Ollama, text-generation-webui).
# Example with llama.cpp
./llama-cli -m Qwopus-3.5-27B-V3-Stabbed-Q4_K_M.gguf -p "Your prompt here"