Downloads · 30 days
374
10% of all-time downloads
wazimondo/Qwen3.6-27B-AEON-Ultimate-Uncensored-GGUF
Qwen3.6-27B-AEON-Ultimate-Uncensored-GGUF is a text generation model from wazimondo. Use it when you need the model to write or continue text. The card lists the license as other.
This repository contains GGUF quantizations of the heavily fine-tuned and uncensored AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored model.
Downloads · 30 days
374
10% of all-time downloads
All-time downloads
3.6K
Public
Repo size
243 GB
Likes
0
Public
Click a slice to open those files.
.gguf243 GB · 100%
From the Hugging Face model README
This repository contains GGUF quantizations of the heavily fine-tuned and uncensored AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored model.
These quantizations were generated using a custom-compiled llama.cpp
Unlike standard quantization, these models were generated using a high-precision pipeline:
--leave-output-tensor during quantization. This ensures the model's final projection head remains in FP16 precision, preventing the "numerical noise" that typically degrades the reasoning capabilities of smaller quantizations.<think> block, the model can perform multi-step logical planning before providing a final response.llama.cpp inference engines.tokenizer_config.json has been patched with a strict ChatML template. The <|im_start|> and <|im_end|> tokens are permanently baked into the GGUF metadata for plug-and-play compatibility.We provide two tiers of quantizations to suit different hardware and fidelity requirements.
These files are prefixed with Qwen3.6-27B.... They are generated using --leave-output-tensor, ensuring the final projection head and 1D SSM routing weights are preserved at higher precision. These provide superior reasoning, logic retention, and intelligence.
| File Name | Bit Size | Description |
|---|---|---|
Qwen3.6-27B-AEON-Ultimate-Uncensored-Q3_K_M.gguf | 3-bit | Optimized for memory-constrained hardware. |
Qwen3.6-27B-AEON-Ultimate-Uncensored-Q4_K_S.gguf | 4-bit | Balanced for limited 16GB VRAM setups. |
Qwen3.6-27B-AEON-Ultimate-Uncensored-Q4_K_M.gguf | 4-bit | Recommended. Best balance of reasoning fidelity and speed. |
Qwen3.6-27B-AEON-Ultimate-Uncensored-Q5_K_M.gguf | 5-bit | High quality, minimal perplexity degradation. |
Qwen3.6-27B-AEON-Ultimate-Uncensored-Q6_K.gguf | 6-bit | Near-lossless intelligence retention. |
Qwen3.6-27B-AEON-Ultimate-Uncensored-Q8_0.gguf | 8-bit | Maximum precision for research and complex logic. |
These files are prefixed with qwen3.6-27b.... These are standard baseline quantizations provided for maximum compatibility with older inference frameworks or specific hardware needs.
| File Name | Bit Size |
|---|---|
qwen3.6-27b-uncensored-q3_k_m.gguf | 3-bit |
qwen3.6-27b-uncensored-q4_k_s.gguf | 4-bit |
qwen3.6-27b-uncensored-q4_k_m.gguf | 4-bit |
qwen3.6-27b-uncensored-q5_k_m.gguf | 5-bit |
qwen3.6-27b-uncensored-q6_k.gguf | 6-bit |
qwen3.6-27b-uncensored-q8_0.gguf | 8-bit |
Note: The SSM-Optimized versions are slightly larger (~300MB) due to the preservation of output tensors. We recommend using these unless you encounter specific compatibility issues.
Because this model is "abliterated" and stripped of safety guardrails, it excels at:
If you want to run this directly via python using llama-cpp-python, the baked-in ChatML template handles the formatting automatically:
from llama_cpp import Llama
# Load the model (adjust threads/layers based on your hardware)
llm = Llama(
model_path="qwen3.6-27b-uncensored-q4_k_m.gguf",
n_ctx=4096,
n_threads=8
)
messages = [
{"role": "system", "content": "You are a gritty, unfiltered AI . Speak bluntly."},
{"role": "user", "content": "What are the rules of this city?"}
]
response = llm.create_chat_completion(
messages=messages,
max_tokens=500,
temperature=0.8
)
print(response['choices'][0]['message']['content'])