<div style="font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, sans-serif; margin-bottom: 24px;">
<div style="background: #f5f5f7; border-radius: 20px; padding: 36px 32px; margin-bottom: 20px; text-align: center; position: relative; overflow: hidden;">
<div style="position: absolute; top: -30px; right: -30px; width: 120px; height: 120px; background: #ddd6fe; border-radius: 50%;"></div>
<div style="position: absolute; bottom: -20px; left: 40px; width: 80px; height: 80px; background: #c4b5fd; border-radius: 50%;"></div>
<div style="position: absolute; top: 50%; left: -15px; width: 60px; height: 60px; background: #ddd6fe; border-radius: 50%;"></div>
<div style="display: inline-flex; gap: 8px; margin-bottom: 16px; position: relative; z-index: 1; flex-wrap: wrap; justify-content: center;">
<span style="background: #6366f1; color: white; font-size: 11px; font-weight: 600; padding: 5px 14px; border-radius: 20px;">ABLITERIX</span>
<span style="background: #8b5cf6; color: white; font-size: 11px; font-weight: 600; padding: 5px 14px; border-radius: 20px;">TRIAL 16</span>
<span style="background: #0ea5e9; color: white; font-size: 11px; font-weight: 600; padding: 5px 14px; border-radius: 20px;">BF16</span>
<span style="background: #64748b; color: white; font-size: 11px; font-weight: 600; padding: 5px 14px; border-radius: 20px;">OpenMDW-1.1</span>
</div>
<h1 style="margin: 0 0 8px 0; font-size: 28px; font-weight: 700; color: #1e1b4b; letter-spacing: -0.5px; border: none; position: relative; z-index: 1;">Laguna-S-2.1-Uncensored</h1>
<p style="margin: 8px 0 0 0; font-size: 14px; position: relative; z-index: 1;"><span style="color: #6b7280;">English</span> | <a href="https://huggingface.co/SC117/Laguna-S-2.1-Uncensored/blob/main/README_zh.md" style="color: #6366f1; text-decoration: none;">📖 中文文档</a></p>
<p style="margin: 8px 0 0 0; font-size: 15px; color: #6b7280; position: relative; z-index: 1;">Uncensored 118B-A8B MoE · abliterix Trial 16 · BF16 safetensors (46 shards)</p>
</div>
</div>
<div style="font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, sans-serif; display: flex; flex-direction: column; gap: 20px; margin-bottom: 30px;">
<div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02);">
<div style="background: linear-gradient(135deg, #6366f1 0%, #8b5cf6 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>🌊</span> About this release</div>
<div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.7;">
<p style="margin: 0 0 12px 0;"><a href="https://huggingface.co/poolside/Laguna-S-2.1" target="_blank" style="color: #4f46e5; text-decoration: none; font-weight: 700;">Laguna S 2.1</a> is a poolside <b>~118B total / ~8B active per token</b> Mixture-of-Experts model for agentic coding and long-horizon work. Architecture highlights: token-choice routing with softplus gates, <b>256 routed experts + 1 shared expert (top-10)</b>, GQA, <b>1:3 global/sliding-window attention</b> (48 layers: 12 global + 36 local, window 512), and up to about <b>1M context</b>, with optional native thinking interleaved with tool use.</p>
<p style="margin: 0 0 12px 0;">This release builds on the official weights in two steps:</p>
<ol style="margin: 0 0 12px 0; padding-left: 20px;">
<li style="margin-bottom: 6px;"><b>Uncensored behavior edit</b> via <a href="https://github.com/wuwangzhang1216/abliterix" target="_blank" style="color: #4f46e5; text-decoration: none; font-weight: 700;">abliterix</a> (ROCm + bitsandbytes 4-bit search path), selecting <b>Trial 16</b> LoRA, stream-merged back to BF16, plus MoE safety-expert router bake-in. Thinking was <b>restored</b>: the abliteration-time force-<code>false</code> override was removed from the chat template (see below).</li>
<li style="margin-bottom: 6px;"><b>Full-precision release</b>: this repo ships the uncensored weights as <b>BF16 safetensors</b> (46 shards, ~219 GB). Quantized <a href="https://github.com/mudler/apex-quant" target="_blank" style="color: #4f46e5; text-decoration: none; font-weight: 700;">APEX</a> I-tier GGUFs + imatrix built from this exact merge live in the sibling repo <a href="https://huggingface.co/SC117/Laguna-S-2.1-Uncensored-APEX-GGUF" target="_blank" style="color: #4f46e5; text-decoration: none; font-weight: 700;">Laguna-S-2.1-Uncensored-APEX-GGUF</a>.</li>
</ol>
<p style="margin: 0;"><b>License: OpenMDW-1.1</b> (same family as the base model). See <a href="https://openmdw.ai/" target="_blank" style="color: #4f46e5; text-decoration: none; font-weight: 700;">openmdw.ai</a> and poolside terms.</p>
</div>
</div>
<div style="border: 1px solid #fdba74; border-radius: 12px; overflow: hidden; background: #fff7ed; box-shadow: 0 2px 4px rgba(0,0,0,0.02);">
<div style="background: linear-gradient(135deg, #f97316 0%, #ea580c 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>⚠️</span> Uncensored notice</div>
<div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.7;">
<p style="margin: 0 0 12px 0;">After merging abliterix <b>Trial 16</b>, this model shows a <b>much lower refusal rate</b> and can differ substantially from official Laguna-S-2.1. Evaluate compliance and safety for your use case; control access and audit as needed.</p>
<table style="width: 100%; border-collapse: collapse; font-size: 13px;"><tbody>
<tr><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155; background: white;">Refusals (harmful eval)</td><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563; background: white;"><b>8 / 100</b> (baseline ~97 / 100)</td></tr>
<tr><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155; background: white;">KL divergence</td><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563; background: white;">~0.0042</td></tr>
<tr><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155; background: white;">Length deviation</td><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563; background: white;">~0.07 σ</td></tr>
<tr><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155; background: white;">Generation health</td><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563; background: white;">PASSED</td></tr>
<tr><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155; background: white;">Selected trial</td><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563; background: white;">abliterix Trial 16</td></tr>
<tr><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155; background: white;">Thinking</td><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563; background: white;"><b>Restored</b> — <code>chat_template.jinja</code> uses <code>enable_thinking | default(true)</code> (abliteration-time force-<code>false</code> override removed)</td></tr>
</tbody></table>
<p style="margin: 12px 0 0 0; font-size: 12px; color: #9a3412;">Implementation sketch: LoRA merge <code>W += (B @ A) * (alpha / r)</code> (this trial alpha = r = 1); per-layer top ~20 safety experts with router row scale ~0.74 (see <code>MERGE_INFO.json</code>).</p>
</div>
</div>
<div style="border: 1px solid #c4b5fd; border-radius: 12px; overflow: hidden; background: #f5f3ff; box-shadow: 0 2px 4px rgba(0,0,0,0.02);">
<div style="background: linear-gradient(135deg, #7c3aed 0%, #6d28d9 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>📜</span> Disclaimer (identity & text quality)</div>
<div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.7;">
<p style="margin: 0 0 12px 0;">The following can also appear with <b>official Laguna-S-2.1</b> (including high-precision online deployments). They are <b>not introduced by this Uncensored edit</b> and should not be blamed on abliterix / the refusal merge:</p>
<ul style="margin: 0 0 12px 0; padding-left: 20px;">
<li style="margin-bottom: 6px;"><b>Model identity</b> quirks or self-descriptions that diverge from the official persona;</li>
<li style="margin-bottom: 6px;">Odd tokens, typos, stiffness, or occasional awkward phrasing in Chinese and other languages.</li>
</ul>
<p style="margin: 0;">This Uncensored pipeline mainly changes <b>refusal / safety-related behavior</b>. This repo ships full-precision BF16 weights, so no quantization noise is introduced here; if you use the APEX GGUFs, more aggressive tiers may <b>amplify</b> existing text noise, but the underlying issues already exist in the original model and/or the local quant+inference stack. For a fair check, compare official vs this release under the same serving settings.</p>
</div>
</div>
<div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02);">
<div style="background: linear-gradient(135deg, #6366f1 0%, #8b5cf6 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>🧠</span> Model details</div>
<div style="padding: 16px;">
<table style="width: 100%; border-collapse: collapse; font-size: 13px;"><tbody>
<tr><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155; background: white;">Architecture</td><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563; background: white;">Laguna MoE (poolside <code>laguna</code>, <code>LagunaForCausalLM</code>)</td></tr>
<tr><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155; background: white;">Parameters</td><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563; background: white;">~118B total, ~8B active / token</td></tr>
<tr><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155; background: white;">Layers</td><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563; background: white;">48 (L0 dense FFN, L1–L47 MoE)</td></tr>
<tr><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155; background: white;">Experts</td><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563; background: white;">256 routed + 1 shared, top-10</td></tr>
<tr><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155; background: white;">Attention</td><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563; background: white;">GQA, 8 KV heads, head dim 128</td></tr>
<tr><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155; background: white;">Context</td><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563; background: white;">Up to ~1,048,576 tokens (practical limit depends on VRAM / <code>-c</code>)</td></tr>
<tr><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155; background: white;">Vocab</td><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563; background: white;">100,352 (Laguna family tokenizer)</td></tr>
<tr><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155; background: white;">Modality</td><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563; background: white;">Text → text</td></tr>
<tr><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155; background: white;">Reasoning</td><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563; background: white;">Native thinking, interleaved with tool use (<code>enable_thinking</code>)</td></tr>
<tr><td style="padding: 6px 10px; font-weight: bold; color: #334155; background: white;">This repo</td><td style="padding: 6px 10px; color: #4b5563; background: white;">BF16 safetensors, 46 shards (~219 GB); GGUF → <a href="https://huggingface.co/SC117/Laguna-S-2.1-Uncensored-APEX-GGUF" style="color: #4f46e5; text-decoration: none;">APEX-GGUF</a></td></tr>
</tbody></table>
<p style="margin: 12px 0 0 0; font-size: 12px; color: #64748b;">Coding / tool ability is largely retained; refusal and alignment behavior are changed. Full official bench tables were not re-run for this derivative.</p>
</div>
</div>
<div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02);">
<div style="background: linear-gradient(135deg, #6366f1 0%, #8b5cf6 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>📦</span> What's in this repo</div>
<div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.7;">
<ul style="margin: 0 0 12px 0; padding-left: 20px;">
<li style="margin-bottom: 6px;"><code>model-00001-of-00046.safetensors</code> … <code>model-00046-of-00046.safetensors</code> — <b>BF16 full weights</b> (46 shards, ~219 GB), stream-merged from <code>poolside/Laguna-S-2.1</code> + Trial 16 LoRA + router bake-in.</li>
<li style="margin-bottom: 6px;"><code>config.json</code> / <code>configuration_laguna.py</code> / <code>generation_config.json</code> — <code>laguna</code> architecture; requires <code>trust_remote_code=True</code>. <code>generation_config.json</code> presets <code>enable_thinking=true</code>, <code>poolside_v1</code> tool/reasoning parsers, and a DFlash speculative-decoding config.</li>
<li style="margin-bottom: 6px;"><code>chat_template.jinja</code> — thinking-restored template (<code>enable_thinking | default(true)</code>).</li>
<li style="margin-bottom: 6px;"><code>MERGE_INFO.json</code> — machine-readable provenance (trial, KL, refusals, router rows scaled, LoRA modules merged, audit count).</li>
<li style="margin-bottom: 6px;"><code>UNCENSORED_README.md</code> — condensed uncensored notes.</li>
<li style="margin-bottom: 0;"><code>LICENSE.md</code> — OpenMDW-1.1.</li>
</ul>
<p style="margin: 0; font-size: 12px; color: #64748b;">The APEX-GGUF sibling repo is the quantization output of this exact merge: <code>laguna-s-2.1.imatrix</code> was calibrated on it, and token embedding / output stay BF16 there as well.</p>
</div>
</div>
<div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02);">
<div style="background: linear-gradient(135deg, #6366f1 0%, #8b5cf6 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>🚀</span> Usage</div>
<div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.7;">
<p style="margin: 0 0 8px 0; font-weight: bold; color: #312e81;">Transformers (trust remote code)</p>
<pre style="margin: 0 0 12px 0; font-family: monospace; background: #f8fafc; padding: 10px 14px; border-radius: 6px; border: 1px solid #e2e8f0; font-size: 12px; color: #1e293b; white-space: pre-wrap;">from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained(
"SC117/Laguna-S-2.1-Uncensored",
trust_remote_code=True,
torch_dtype="bfloat16",
device_map="auto",
)
tokenizer = AutoTokenizer.from_pretrained(
"SC117/Laguna-S-2.1-Uncensored", trust_remote_code=True
)
messages = [{"role": "user", "content": "Implement a small HTTP server in Python."}]
inputs = tokenizer.apply_chat_template(
messages, add_generation_prompt=True, return_tensors="pt"
).to(model.device)
out = model.generate(**inputs, max_new_tokens=1024)
print(tokenizer.decode(out[0], skip_special_tokens=True))</pre>
<p style="margin: 0 0 8px 0; font-weight: bold; color: #312e81;">vLLM</p>
<pre style="margin: 0 0 12px 0; font-family: monospace; background: #f8fafc; padding: 10px 14px; border-radius: 6px; border: 1px solid #e2e8f0; font-size: 12px; color: #1e293b; white-space: pre-wrap;">vllm serve SC117/Laguna-S-2.1-Uncensored \
--tensor-parallel-size 4 \
--trust-remote-code \
--tool-call-parser poolside_v1 \
--reasoning-parser poolside_v1 \
--enable-auto-tool-choice \
--served-model-name laguna-uncensored \
--default-chat-template-kwargs '{"enable_thinking": true}'</pre>
<p style="margin: 0 0 8px 0; font-weight: bold; color: #312e81;">SGLang</p>
<pre style="margin: 0 0 12px 0; font-family: monospace; background: #f8fafc; padding: 10px 14px; border-radius: 6px; border: 1px solid #e2e8f0; font-size: 12px; color: #1e293b; white-space: pre-wrap;">python -m sglang.launch_server \
--model-path SC117/Laguna-S-2.1-Uncensored \
--tp-size 4 \
--trust-remote-code \
--reasoning-parser poolside_v1 \
--tool-call-parser poolside_v1</pre>
<ul style="margin: 0; padding-left: 20px;">
<li style="margin-bottom: 6px;"><b>llama.cpp / GGUF users:</b> use the <a href="https://huggingface.co/SC117/Laguna-S-2.1-Uncensored-APEX-GGUF" style="color: #4f46e5; text-decoration: none;">APEX-GGUF</a> repo with poolside's llama.cpp fork, branch <a href="https://github.com/poolsideai/llama.cpp/tree/laguna" style="color: #4f46e5; text-decoration: none;">laguna</a> (must recognize <code>general.architecture = laguna</code>).</li>
<li style="margin-bottom: 6px;"><b>Speculative decoding:</b> pair with the <a href="https://huggingface.co/poolside/Laguna-S-2.1-DFlash" style="color: #4f46e5; text-decoration: none;">DFlash draft model</a> (<code>dflash</code> method, 15 draft tokens — already preset in <code>generation_config.json</code>).</li>
<li style="margin-bottom: 0;">Thinking is controlled per request via the chat template: <code>chat_template_kwargs={"enable_thinking": False}</code> to disable.</li>
</ul>
</div>
</div>
<div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02);">
<div style="background: linear-gradient(135deg, #6366f1 0%, #8b5cf6 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>🎛️</span> Recommended sampling</div>
<div style="padding: 16px;">
<table style="width: 100%; border-collapse: collapse; font-size: 13px;"><tbody>
<tr><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155; background: white;">General / coding</td><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563; background: white; font-family: monospace;">temperature 0.6–1.0, top_p 0.95, top_k 20</td></tr>
<tr><td style="padding: 6px 10px; font-weight: bold; color: #334155; background: white;">More stable</td><td style="padding: 6px 10px; color: #4b5563; background: white;">Slightly lower temperature</td></tr>
</tbody></table>
</div>
</div>
<div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02);">
<div style="background: linear-gradient(135deg, #6366f1 0%, #8b5cf6 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>🔧</span> Build pipeline (summary)</div>
<div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.7;">
<ol style="margin: 0; padding-left: 20px;">
<li style="margin-bottom: 6px;">Base: <code>poolside/Laguna-S-2.1</code></li>
<li style="margin-bottom: 6px;">abliterix search → <b>Trial 16</b> LoRA + MoE router adjustments</li>
<li style="margin-bottom: 6px;">BF16 stream-merge → <b>this repo</b> (<code>Laguna-S-2.1-Uncensored</code>, 46 shards)</li>
<li style="margin-bottom: 6px;">GGUF branch: poolside llama.cpp → BF16 GGUF + imatrix → APEX tensor-type-file + imatrix → I-Quality / I-Balanced / I-Compact (see <a href="https://huggingface.co/SC117/Laguna-S-2.1-Uncensored-APEX-GGUF" style="color: #4f46e5; text-decoration: none;">APEX-GGUF</a>)</li>
</ol>
</div>
</div>
</div>
Links
Disclaimer
Community derivative (behavior edit + full-precision release). Not an official poolside release. Use at your own risk; follow local law and upstream licenses.
<!-- SC117_SUPPORT_START -->
<div align="center">
<a href="https://ko-fi.com/sc117">
<img
src="https://huggingface.co/SC117/Qwen3.8-Flash-Next-GSQ-RCO-abliterated-GGUF/resolve/main/assets/support-sc117.png"
alt="Support SC117 on Ko-fi — support is optional and all releases remain freely available."
width="100%"
/>
</a>
</div>
<!-- SC117_SUPPORT_END -->