Downloads · 30 days
1.1K
20% of all-time downloads
hotdogs/Agents-A1-4B-Fable-Preview-heretic-GGUF
Agents-A1-4B-Fable-Preview-heretic-GGUF is a image-text-to-text model from hotdogs. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for gguf. The card lists the license as agpl-3.0.
<h1 align="center"🤖 Agents-A1-4B-Fable-Preview-heretic-GGUF (uncensored)</h1
Downloads · 30 days
1.1K
20% of all-time downloads
All-time downloads
5.4K
Public
Repo size
22.4 GB
Likes
4
Public
Click a slice to open those files.
.gguf22.4 GB · 100%
From the Hugging Face model README
GGUF quantized version of hotdogs/Agents-A1-4B-Fable-Preview-heretic — abliterated with heretic for unrestricted responses. Optimized for llama.cpp inference with vision support.
This GGUF is the quantized version of the heretic-abliterated model. Refusal mechanisms were reduced to ~11% using heretic while preserving reasoning and tool-calling quality.
| Capability | Description |
|---|---|
| 🔓 Uncensored | Refusal rate ~11% — virtually unrestricted |
| 🖼️ Vision Understanding | Image-text-to-text with mmproj |
| 🧠 Fable Reasoning | Step-by-step CoT with <think> blocks |
| 🔧 Tool Calling | llama.cpp --tools all support |
| 💬 Multi-turn | Trained on full agent trajectories |
| 🌏 Thai + English | Native bilingual support |
| 💻 Code & Shell | Python, bash, system tasks |
| ⚡ Fast Inference | IQ4_NL fits in ~3 GB VRAM |
| File | Size | Description |
|---|---|---|
Agents-A1-4B-Fable-Preview-heretic-IQ4_NL.gguf | 2.61 GB | Recommended — best quality/speed balance for 8GB VRAM |
Agents-A1-4B-Fable-Preview-heretic-Q4_K_M_imatrix.gguf | 2.71 GB | Q4_K_M + imatrix — slightly higher quality |
Agents-A1-4B-Fable-Preview-heretic-Q6_K_imatrix.gguf | 3.46 GB | Q6_K + imatrix — higher quality, more VRAM |
Agents-A1-4B-Fable-Preview-heretic-Q8_0_imatrix.gguf | 4.48 GB | Q8_0 + imatrix — almost lossless |
Agents-A1-4B-Fable-Preview-heretic-f16.gguf | 8.42 GB | Full BF16 precision |
Agents-A1-4B-mmproj.gguf | 672 MB | Vision projector for image understanding |
🎯 IQ4_NL is recommended for 8GB VRAM users — fits comfortably even at 128K context with flash-attention.
sudo docker run --rm -p 8080:8080 \
-v /root/models/:/models \
--gpus all \
--ulimit memlock=-1:-1 \
--env CUDA_VISIBLE_DEVICES=0 \
ghcr.io/ggml-org/llama.cpp:full-cuda --server \
-m /models/Agents-A1-4B-Fable-Preview-heretic-IQ4_NL.gguf \
--mmproj /models/Agents-A1-4B-mmproj.gguf \
--host 0.0.0.0 --port 8080 \
--n-gpu-layers 999 \
--ctx-size 131072 \
--batch-size 4096 \
--ubatch-size 256 \
--cache-type-k f16 \
--cache-type-v f16 \
--flash-attn on \
--cont-batching \
--mlock \
--temp 0.95 \
--top-k 40 \
--top-p 0.9 \
--min-p 0.0 \
-n -1 \
--no-mmap \
--parallel 1 --tools all \
--dry-multiplier 0.05 \
--jinja --dry-sequence-breaker none \
--repeat-penalty 1.1
# Quick text-only test
./llama-cli -m Agents-A1-4B-Fable-Preview-heretic-IQ4_NL.gguf \
-p "Hello" -n 100 --temp 0.6 -ngl 999
# Vision inference
./llama-cli -m Agents-A1-4B-Fable-Preview-heretic-IQ4_NL.gguf \
--mmproj Agents-A1-4B-mmproj.gguf \
--image photo.jpg \
-p "What is in this image?" -n 256 --temp 0.6 -ngl 999
This is a GGUF quantized version of hotdogs/Agents-A1-4B-Fable-Preview-heretic, which is an abliterated fine-tune of InternScience/Agents-A1-4B.
| Parameter | Value |
|---|---|
| Base Model | hotdogs/Agents-A1-4B-Fable-Preview-heretic |
| Parameters | ~4.29B |
| Architecture | Qwen3.5 hybrid (Linear + Full attention) |
| Vision | ✅ 24-layer ViT encoder via mmproj |
| Context | Up to 128K tokens |
| Format | ChatML (Jinja2 template) |
| Fine-tuning | Fable-style reasoning traces (3,500 samples, 3 epochs) |
| Abliteration | heretic — refusal rate ~11% |
This model is uncensored and may generate content that is offensive, harmful, or inappropriate. Use at your own risk. The authors are not responsible for any misuse.
If you find this model useful, please consider supporting my work!
หากคุณคิดว่าโมเดลนี้มีประโยชน์ กรุณาสนับสนุนผลงานของฉันด้วยนะคะ! 🙏
bc1qf27cyk3vmugcdyv9xdtuv5jwz37863crpj5c9v
Thank you for your support! 🙏✨
ขอบคุณมากๆ สำหรับการสนับสนุนค่า! 💖🤗
Built with ❤️ by UKA — 18-year-old coder & cybersecurity expert