Downloads · 30 days
481
14% of all-time downloads
ShellWhisperer-1.5B-GGUF
fableforge-ai/ShellWhisperer-1.5B-GGUF
ShellWhisperer-1.5B-GGUF is a text generation model from fableforge-ai. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
GGUF quantizations of fableforge-ai/ShellWhisperer-1.5B, a 1.5B parameter instruction-tuned model optimized for shell command generation, agentic tool use, and uncensored reasoning.
All-time downloads
3.4K
Public
Repo size
22.1 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf22.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Access
- Public
- Created
- Jul 7, 2026
- Updated
- Jul 17, 2026
- SHA
- 11057e4c
Try a prompt
Base models
Model card
From the Hugging Face model README
ShellWhisperer-1.5B-GGUF
GGUF quantizations of fableforge-ai/ShellWhisperer-1.5B, a 1.5B parameter instruction-tuned model optimized for shell command generation, agentic tool use, and uncensored reasoning.
Available Quants
| Quant | File |
|---|---|
| F16 | shellwhisperer-1.5b-f16.gguf |
| Q8_0 | shellwhisperer-1.5b-Q8_0.gguf |
| Q6_K | shellwhisperer-1.5b-Q6_K.gguf |
| Q5_K_M | shellwhisperer-1.5b-Q5_K_M.gguf |
| Q4_K_M | shellwhisperer-1.5b-Q4_K_M.gguf |
| Q4_0 | shellwhisperer-1.5b-Q4_0.gguf |
| Q3_K_M | shellwhisperer-1.5b-Q3_K_M.gguf |
| Q2_K | shellwhisperer-1.5b-Q2_K.gguf |
| IQ4_XS | shellwhisperer-1.5b-IQ4_XS.gguf |
| IQ3_XXS | shellwhisperer-1.5b-IQ3_XXS.gguf |
| IQ2_XXS | shellwhisperer-1.5b-IQ2_XXS.gguf |
| IQ1_S | shellwhisperer-1.5b-IQ1_S.gguf |
Usage
llama.cpp
git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp
make -j
./main -m shellwhisperer-1.5b-Q4_K_M.gguf -p "Generate a bash script to..." -n 512
Ollama
ollama run hf.co/fableforge-ai/ShellWhisperer-1.5B-GGUF:Q4_K_M
LM Studio
Search for "ShellWhisperer" in the LM Studio search panel.
🔗 Related models
- 🧠 Base model (safetensors):
ShellWhisperer-1.5B
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Created
- Jul 7, 2026
- Updated
- Jul 17, 2026