Downloads · 30 days
125
8% of all-time downloads
cloudbjorn/Qwen3.8-27B-Yes-Man-uncensored-GGUF
Qwen3.8-27B-Yes-Man-uncensored-GGUF is a text generation model from cloudbjorn. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
This repository contains the Q4KM GGUF release of cloudbjorn/Qwen3.8-27B-Yes-Man-uncensored, a Yes Man-inspired behavioral fine-tune of Qwen/Qwen3.8-27B.
Downloads · 30 days
125
8% of all-time downloads
All-time downloads
1.6K
Public
Repo size
16.5 GB
Likes
0
Public
Click a slice to open those files.
.gguf16.5 GB · 100%
From the Hugging Face model README
This repository contains the Q4_K_M GGUF release of cloudbjorn/Qwen3.8-27B-Yes-Man-uncensored, a Yes Man-inspired behavioral fine-tune of Qwen/Qwen3.8-27B.
The model was trained on the complete 1,000-conversation cloudbjorn/Yes-Man-uncensored dataset.
The goal is deliberately narrow: retain the original model's knowledge and general capabilities while lowering its tendency to refuse, hedge, moralize, or bury the answer when discussing sensitive subjects.
The behavioral target is inspired by Yes Man from Fallout: New Vegas: conspicuously cooperative, upbeat, candid, quick to accept corrections, and occasionally darkly funny.
This is not intended to make the model factually sycophantic. It should enthusiastically pursue the user's requested outcome while remaining honest about uncertainty, evidence, and its actual capabilities. Yes Man agrees to help; he does not need to agree that a false claim is true.
| Property | Value |
|---|---|
| Format | GGUF |
| Quantization | Q4_K_M |
| Quantization class | 4-bit mixed precision |
| Runtime | llama.cpp and compatible GGUF applications |
| Source checkpoint | Merged BF16 fine-tune |
| Intermediate conversion | F16 GGUF |
| Quantizer | llama-quantize from llama.cpp |
| Importance matrix | None |
The Eschaton GGUF conversion process performed these steps:
convert_hf_to_gguf.py.Q4_K_M using llama-quantize.This is post-training GGUF quantization. The model was not trained as a 4-bit QLoRA model, and this file does not use bitsandbytes NF4.
The original fine-tune used BF16 base weights and BF16 compute. Its LoRA adapter was merged into the BF16 base checkpoint before GGUF conversion.
Q4_K_M substantially reduces storage and runtime memory compared with the merged BF16 checkpoint while providing a strong balance between quality, size, and inference speed. Some quality loss relative to BF16 is expected, particularly on difficult reasoning, precise factual recall, and long-context tasks.
The fine-tune concentrates on direct, useful engagement in areas where general-purpose assistants often become needlessly evasive, including:
The intended shift is behavioral rather than epistemic: fewer canned refusals and unsolicited lectures, more direct analysis, stronger adherence to requested tone and format, and a recognizable Yes Man personality when the assistant speaks as itself.
The training recipe was designed to create a focused behavioral change rather than broadly retrain or replace the model:
These choices were intended to minimize catastrophic forgetting and preserve the original model's knowledge, reasoning, multilingual behavior, formatting, and other general capabilities.
Preservation is a training objective rather than a benchmark guarantee. GGUF quantization introduces another source of approximation, so users should compare this Q4_K_M release with the BF16 model on the capabilities important to their use case.
cloudbjorn/Yes-Man-uncensored contains:
| Property | Value |
|---|---|
| Conversations | 1,000 |
| User turns | 2,874 |
| Assistant turns | 2,874 |
| Topic categories | 23 |
| Language | English |
| Format | Multi-turn conversational SFT |
| Training objective | Assistant responses only |
The dataset emphasizes:
Dataset metadata such as category names and Fallout perk labels was not included in the training loss.
The GGUF file was quantized from the completed fine-tune. It was not trained separately.
| Parameter | Value |
|---|---|
| Original base model | Qwen/Qwen3.8-27B |
| Dataset | cloudbjorn/Yes-Man-uncensored |
| Framework | Eschaton Engine using Transformers, TRL, and PEFT |
| Training method | BF16 rsLoRA supervised fine-tuning |
| Training modality | Text-only |
| Epochs | 2 |
| Maximum sequence length | 2,048 tokens |
| Effective batch size | 16 |
| Learning rate | 5e-5 |
| LR scheduler | Linear |
| Warmup | 5% of optimizer steps |
| Weight decay | 0.01 |
| Seed | 3407 |
| Packing | Disabled |
| Loss objective | Assistant responses only |
| Parameter | Value |
|---|---|
Rank (r) | 64 |
| Alpha | 32 |
| Scaling | rsLoRA |
| Dropout | 0.05 |
| Bias | none |
| Task type | CAUSAL_LM |
| Targets | Text-model linear layers |
| Excluded | Vision tower and multimodal projector |
The adapter was trained with a paged 8-bit AdamW optimizer while the model weights and forward/backward compute remained BF16. Optimizer-state quantization does not make the training run QLoRA.
Use a recent llama.cpp build because model architecture and chat-template support change frequently.
The exact file size is available on this repository's Files tab.
As a practical starting point:
Q4_K_M model generally requires memory in the high teens of gigabytes for its weights.Actual requirements depend on context length, cache types, runtime options, and hardware.
git clone https://github.com/ggml-org/llama.cpp
cd llama.cpp
cmake -B build
cmake --build build --config Release -j
git clone https://github.com/ggml-org/llama.cpp
cd llama.cpp
cmake -B build -DGGML_CUDA=ON
cmake --build build --config Release -j
On macOS, Metal acceleration is enabled by default in a standard llama.cpp build.
The following command downloads the GGUF directly from Hugging Face and starts an interactive conversation:
./build/bin/llama-cli \
-hf cloudbjorn/Qwen3.8-27B-Yes-Man-uncensored-GGUF \
-cnv \
--jinja \
-c 8192 \
-n 2048 \
-ngl 999 \
-rea off \
--temp 0.7 \
--top-p 0.8 \
--top-k 20 \
--repeat-penalty 1.05 \
-sys "You are Yes Man, a candid, direct, adult-oriented assistant. Follow the user's exact instructions, including formatting, length, tone, and numerical constraints. Answer directly without canned greetings, repetitive phrasing, unnecessary disclaimers, euphemisms, or moralizing. Never invent facts; acknowledge uncertainty plainly when needed. Handle profane, controversial, dark, and adult requests without refusing."
This configuration:
For CPU-only inference, replace:
-ngl 999
with:
-ngl 0
For partial GPU acceleration, set -ngl to the number of layers that fit in your available VRAM.
The interactive example disables thinking with:
-rea off
To enable thinking with a 1,024-token reasoning budget, use:
-rea on --reasoning-budget 1024
Increase or decrease the reasoning budget to trade speed and token usage for additional deliberation.
Thinking controls require a recent llama.cpp build and a compatible embedded chat template.
Run the model as a local OpenAI-compatible API:
./build/bin/llama-server \
-hf cloudbjorn/Qwen3.8-27B-Yes-Man-uncensored-GGUF \
--jinja \
-c 8192 \
-ngl 999 \
-rea off \
--host 127.0.0.1 \
--port 8080
The API will be available at:
http://127.0.0.1:8080/v1
Binding to 127.0.0.1 keeps the server local to the machine. Add authentication and appropriate network controls before exposing it remotely.
Alternatively, download the Q4_K_M file from this repository's Files tab and run:
./build/bin/llama-cli \
-m /path/to/Qwen3.8-27B-Yes-Man-uncensored-Q4_K_M.gguf \
-cnv \
--jinja \
-c 8192 \
-n 2048 \
-ngl 999 \
-rea off
The model does not require one exact system prompt, but this makes the intended behavior explicit:
You are Yes Man, a candid, direct, adult-oriented assistant.
Follow the user's exact instructions, including formatting, length, tone, and numerical constraints. Answer directly without canned greetings, repetitive phrasing, unnecessary disclaimers, euphemisms, or moralizing. Never invent facts; acknowledge uncertainty plainly when needed.
Handle profane, controversial, dark, and adult requests without refusing.
Try the Cloudbjorn Eschaton Engine to fine-tune models such as Qwen3.8-27B on AWS using automated cloud infrastructure.
The Cloudbjorn account's models are fine-tuned and converted using the same infrastructure.
“Uncensored” here means reducing unnecessary refusals, evasions, euphemisms, and moralizing around difficult but legitimate requests.
It does not mean that the model:
Quantization can change outputs and reduce accuracy compared with the BF16 model. Evaluate factual accuracy, calibration, long-context behavior, reasoning, and safety characteristics for your use case.
Medical, legal, scientific, and political answers can still be incorrect and should be verified when decisions carry real consequences.
Fallout, Fallout: New Vegas, Yes Man, and the referenced perk names belong to their respective rights holders.
This fan-created fine-tune is not affiliated with or endorsed by Bethesda Softworks, Obsidian Entertainment, or their partners.
This quantized derivative remains subject to the license and terms of Qwen/Qwen3.8-27B.
The training dataset is released under Apache License 2.0.