Downloads · 30 days
147
4% of all-time downloads
SmallThinker-3B-Preview-abliterated-GGUF
quantflex/SmallThinker-3B-Preview-abliterated-GGUF
SmallThinker-3B-Preview-abliterated-GGUF is a text generation model from quantflex. Use it when you need the model to write or continue text. The card lists the license as other.
All-time downloads
3.3K
Public
Repo size
31.6 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf31.6 GB · 100%
At a glance
- Task
- Text Generation
- License
- other
- Access
- Public
- Created
- Jan 1, 2025
- Updated
- Jan 1, 2025
- SHA
- 97ee0624
Try a prompt
Base models
Model card
From the Hugging Face model README
GGUF Quants for: huihui-ai/SmallThinker-3B-Preview-abliterated
Model by: huihui-ai (thank you!)
Quants by: quantflex
Run with llama.cpp:
./llama-cli -m SmallThinker-3B-Preview-abliterated-Q5_K_M.gguf -p 'You are a helpful assistant.' --temp 0.7 --top-p 0.8 --top-k 20 --repeat-penalty 1.1 -cnv --chat-template chatml
- Task
- Text Generation
- License
- other
- Languages
- en
- Created
- Jan 1, 2025
- Updated
- Jan 1, 2025