Downloads · 30 days
586
11% of all-time downloads
Mythos-nano-GGUF
squ11z1/Mythos-nano-GGUF
Mythos-nano-GGUF is a text generation model from squ11z1. Use it when you need the model to write or continue text. The card lists the license as mit.
GGUF quantizations of squ11z1/Mythos-nano (3B reasoning model, Qwen2-class) for llama.cpp / Ollama / LM Studio.
All-time downloads
5.5K
Public
Repo size
6.2 GB
Likes
7
Public
Repo makeup
Click a slice to open those files.
.gguf26.2 GB · 100%
At a glance
- Task
- Text Generation
- License
- mit
- Access
- Public
- Created
- Jun 14, 2026
- Updated
- Jul 14, 2026
- SHA
- b2c7e323
Try a prompt
Base models
Spaces
Model card
From the Hugging Face model README
Mythos-nano — GGUF
GGUF quantizations of squ11z1/Mythos-nano
(3B reasoning model, Qwen2-class) for llama.cpp / Ollama / LM Studio.
⚠️ Abliterated (uncensored): the refusal direction has been removed — this model will not decline requests a safety-tuned model normally would. Use responsibly, at your own risk. 🚨 Not trained for tool-calling / agentic coding — best on competition-style math & code.
Quants
| File | Quant | Size | Notes |
|---|---|---|---|
mythos-nano-Q2_K.gguf | Q2_K | 1.27 GB | smallest, lowest quality |
mythos-nano-Q3_K_S.gguf | Q3_K_S | 1.45 GB | |
mythos-nano-Q3_K_M.gguf | Q3_K_M | 1.59 GB | |
mythos-nano-Q3_K_L.gguf | Q3_K_L | 1.71 GB | |
mythos-nano-Q4_K_S.gguf | Q4_K_S | 1.83 GB | |
mythos-nano-Q4_K_M.gguf | Q4_K_M | 1.93 GB | recommended balance |
mythos-nano-Q5_K_S.gguf | Q5_K_S | 2.17 GB | |
mythos-nano-Q5_K_M.gguf | Q5_K_M | 2.22 GB | high quality |
mythos-nano-Q6_K.gguf | Q6_K | 2.54 GB | near-lossless |
mythos-nano-Q8_0.gguf | Q8_0 | 3.29 GB | ~lossless |
mythos-nano-f16.gguf | F16 | 6.18 GB | full precision |
Usage
# llama.cpp
llama-cli -hf squ11z1/Mythos-nano-GGUF:Q4_K_M -p "Find all integer solutions of x^2 - y^2 = 12."
# Ollama
ollama run hf.co/squ11z1/Mythos-nano-GGUF:Q4_K_M
Recommended sampling: temperature 0.6–1.0. This is a reasoning model — expect long chain-of-thought before the final answer.
License
MIT.
- Task
- Text Generation
- License
- mit
- Created
- Jun 14, 2026
- Updated
- Jul 14, 2026