Downloads · 30 days
582
13% of all-time downloads
fableforge-ai/mythos-9b-unhinged-GGUF
mythos-9b-unhinged-GGUF is a text generation model from fableforge-ai. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
GGUF quantizations of King3Djbl/mythos-9b-unhinged, a fully uncensored 9B agent model.
Downloads · 30 days
582
13% of all-time downloads
All-time downloads
4.3K
Public
Repo size
107 GB
Likes
4
Public
Click a slice to open those files.
.gguf107 GB · 100%
From the Hugging Face model README
GGUF quantizations of King3Djbl/mythos-9b-unhinged, a fully uncensored 9B agent model.
| File | Quant | Size | Notes |
|---|---|---|---|
| mythos-9b-unhinged-Q4_K_M.gguf | Q4_K_M | 5.03 GB | ⭐ Best size/quality balance |
| mythos-9b-unhinged-IQ4_XS.gguf | IQ4_XS | 4.56 GB | imatrix — great quality, smaller |
| mythos-9b-unhinged-IQ3_M.gguf | IQ3_M | 3.90 GB | imatrix — low RAM option |
| mythos-9b-unhinged-Q2_K.gguf | Q2_K | 3.28 GB | Very low quality, last resort |
Additional quants available in the source repo.
llama.cpp:
llama-cli -hf fableforge-ai/mythos-9b-unhinged-GGUF:Q4_K_M -p "Hello!"
Ollama:
ollama run hf.co/fableforge-ai/mythos-9b-unhinged-GGUF:Q4_K_M
mythos-9b-unhinged