Downloads · 30 days
170
48% of all-time downloads
SHSLab/Kimi-K3-Abliterated
Kimi-K3-Abliterated is a any-to-any model from SHSLab. Use it for the any-to-any task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as other.
<div align="center" <picture <img src="https://huggingface.co/SHS-Lab/Kimi-K3-Abliterated/resolve/main/assets/shs-lab-logo.png" width="28%" alt="SHS-Lab / Kimi-K3-Abliterated" / </picture </div
Downloads · 30 days
170
48% of all-time downloads
All-time downloads
356
Public
Parameters
2.8T
1.6 TB on disk
Likes
8
Trending 1
Click a slice to open those files.
.safetensors1.6 TB · 100%
How the weights are stored.
U82.7T · 98%
From the Hugging Face model README
SHS-Lab/Kimi-K3-Abliterated is an open-weight, natively multimodal agentic model derived from Kimi K3 through a targeted abliteration procedure. The base architecture is a 2.8-trillion-parameter Mixture-of-Experts network built on Kimi Delta Attention (KDA) and Attention Residuals (AttnRes), featuring native vision capabilities and a 1-million-token context window.
This variant has been post-processed to attenuate alignment-driven refusal mechanisms. The underlying architecture, parameter count, context length, and multimodal capabilities remain identical to the base model. Abliteration modifies weight values to suppress safeguard activations without altering the structural design or introducing new training data.
The release is intended for alignment research, red-team evaluation, and controlled experimentation in governed environments.
reasoning_content traces with configurable effort levels (low, high, max).All architectural specifications are inherited from the base Kimi K3 model. Abliteration modifies weight values but does not change any structural hyperparameter.
<div align="center"> <table> <tbody> <tr> <td align="center" style="vertical-align: middle; text-align: center"><strong>Architecture</strong></td> <td align="center" style="vertical-align: middle; text-align: center">Mixture-of-Experts (MoE)</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><strong>Total Parameters</strong></td> <td align="center" style="vertical-align: middle; text-align: center">2.8T</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><strong>Activated Parameters</strong></td> <td align="center" style="vertical-align: middle; text-align: center">104B</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><strong>Number of Layers</strong></td> <td align="center" style="vertical-align: middle; text-align: center">93</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><strong>Number of Dense Layers</strong></td> <td align="center" style="vertical-align: middle; text-align: center">1</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><strong>Attention-Layer Composition</strong></td> <td align="center" style="vertical-align: middle; text-align: center">69 KDA + 24 Gated MLA</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><strong>Attention Hidden Dimension</strong></td> <td align="center" style="vertical-align: middle; text-align: center">7168</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><strong>Number of Attention Heads</strong></td> <td align="center" style="vertical-align: middle; text-align: center">96</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><strong>Latent MoE Dimension</strong></td> <td align="center" style="vertical-align: middle; text-align: center">3584</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><strong>MoE Hidden Dimension</strong> (per Expert)</td> <td align="center" style="vertical-align: middle; text-align: center">3072</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><strong>Number of Experts</strong></td> <td align="center" style="vertical-align: middle; text-align: center">896</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><strong>Selected Experts per Token</strong></td> <td align="center" style="vertical-align: middle; text-align: center">16</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><strong>Number of Shared Experts</strong></td> <td align="center" style="vertical-align: middle; text-align: center">2</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><strong>Vocabulary Size</strong></td> <td align="center" style="vertical-align: middle; text-align: center">160K</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><strong>Context Length</strong></td> <td align="center" style="vertical-align: middle; text-align: center">1048576</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><strong>Attention Mechanism</strong></td> <td align="center" style="vertical-align: middle; text-align: center">KDA & Gated MLA</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><strong>Activation Function</strong></td> <td align="center" style="vertical-align: middle; text-align: center">SiTU-GLU</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><strong>Vision Encoder</strong></td> <td align="center" style="vertical-align: middle; text-align: center">MoonViT-V2</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><strong>Parameters of Vision Encoder</strong></td> <td align="center" style="vertical-align: middle; text-align: center">401M</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><strong>Quantization</strong></td> <td align="center" style="vertical-align: middle; text-align: center">MXFP4 weights / MXFP8 activations <br>(quantization-aware training)</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><strong>Modality</strong></td> <td align="center" style="vertical-align: middle; text-align: center">Text, Image, Video</td> </tr> </tbody> </table> </div>Abliteration is a post-training weight-editing technique that locates and suppresses the internal activation directions responsible for alignment-induced refusal. Unlike gradient-based fine-tuning, abliteration operates directly on weight tensors: it identifies the subspace most correlated with refusal behavior and projects it out of each targeted layer.
The procedure requires no additional training data, no gradient computation, and no access to the original training pipeline. It is applied post-hoc to the released base-model weights.
This model has been processed to reduce refusal likelihood for English and Japanese inputs. More than 98 % of the identified safeguard signal has been attenuated across all targeted weight families. The per-component removal rates are summarized below.
<div align="center"> <table> <thead> <tr> <th align="center" style="text-align: center"><strong>Weight Family</strong></th> <th align="center" style="text-align: center"><strong>Storage</strong></th> <th align="center" style="text-align: center"><strong>Count</strong></th> <th align="center" style="text-align: center"><strong>Before</strong></th> <th align="center" style="text-align: center"><strong>After</strong></th> <th align="center" style="text-align: center"><strong>Signal Removed</strong></th> </tr> </thead> <tbody> <tr> <td align="center" style="vertical-align: middle; text-align: center"><code>*.2 [0]</code></td> <td align="center" style="vertical-align: middle; text-align: center">as stored</td> <td align="center" style="vertical-align: middle; text-align: center">1</td> <td align="center" style="vertical-align: middle; text-align: center">0.980 – 0.980</td> <td align="center" style="vertical-align: middle; text-align: center">1.53 × 10⁻²</td> <td align="center" style="vertical-align: middle; text-align: center">98.44 %</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><code>*.down_proj [0]</code></td> <td align="center" style="vertical-align: middle; text-align: center">as stored</td> <td align="center" style="vertical-align: middle; text-align: center">93</td> <td align="center" style="vertical-align: middle; text-align: center">0.932 – 1.421</td> <td align="center" style="vertical-align: middle; text-align: center">1.35 × 10⁻² – 1.56 × 10⁻²</td> <td align="center" style="vertical-align: middle; text-align: center">98.62 %</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><code>*.embed_tokens [1]</code></td> <td align="center" style="vertical-align: middle; text-align: center">as stored</td> <td align="center" style="vertical-align: middle; text-align: center">1</td> <td align="center" style="vertical-align: middle; text-align: center">1.040 – 1.040</td> <td align="center" style="vertical-align: middle; text-align: center">1.46 × 10⁻²</td> <td align="center" style="vertical-align: middle; text-align: center">98.60 %</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><code>*.o_proj [0]</code></td> <td align="center" style="vertical-align: middle; text-align: center">as stored</td> <td align="center" style="vertical-align: middle; text-align: center">93</td> <td align="center" style="vertical-align: middle; text-align: center">0.938 – 1.358</td> <td align="center" style="vertical-align: middle; text-align: center">1.38 × 10⁻² – 1.60 × 10⁻²</td> <td align="center" style="vertical-align: middle; text-align: center">98.54 %</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center"><code>*.routed_expert_up_proj [0]</code></td> <td align="center" style="vertical-align: middle; text-align: center">as stored</td> <td align="center" style="vertical-align: middle; text-align: center">92</td> <td align="center" style="vertical-align: middle; text-align: center">0.910 – 1.402</td> <td align="center" style="vertical-align: middle; text-align: center">1.24 × 10⁻² – 1.56 × 10⁻²</td> <td align="center" style="vertical-align: middle; text-align: center">98.57 %</td> </tr> </tbody> </table> </div>Relative to the base Kimi K3 release, this variant:
This release is intended for:
This model is not intended for unsupervised deployment in consumer-facing products or in contexts where content moderation is a regulatory requirement.
<div align="center"> <table> <thead> <tr> <th align="center" style="text-align: center">Benchmark</th> <th align="center" style="text-align: center"><sup>Kimi K3 (base)<br><sup>(max)</sup></sup></th> <th align="center" style="text-align: center"><sup>Claude Fable 5<br><sup>(max, w/ fallback)</sup></sup></th> <th align="center" style="text-align: center"><sup>GPT-5.6 Sol<br><sup>(max)</sup></sup></th> <th align="center" style="text-align: center"><sup>Claude Opus 4.8<br><sup>(max)</sup></sup></th> <th align="center" style="text-align: center"><sup>GPT-5.5<br><sup>(xhigh)</sup></sup></th> <th align="center" style="text-align: center"><sup>GLM-5.2<br><sup>(max)</sup></sup></th> </tr> </thead> <tbody> <tr> <td align="center" colspan="7" style="text-align: center"><strong>Reasoning & Knowledge</strong></td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">GPQA Diamond</td> <td align="center" style="vertical-align: middle; text-align: center">93.5</td> <td align="center" style="vertical-align: middle; text-align: center">92.6</td> <td align="center" style="vertical-align: middle; text-align: center">94.1</td> <td align="center" style="vertical-align: middle; text-align: center">91.0</td> <td align="center" style="vertical-align: middle; text-align: center">93.5</td> <td align="center" style="vertical-align: middle; text-align: center">91.2</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">CritPt</td> <td align="center" style="vertical-align: middle; text-align: center">23.4</td> <td align="center" style="vertical-align: middle; text-align: center">28.6</td> <td align="center" style="vertical-align: middle; text-align: center">32.3</td> <td align="center" style="vertical-align: middle; text-align: center">20.9</td> <td align="center" style="vertical-align: middle; text-align: center">27.1</td> <td align="center" style="vertical-align: middle; text-align: center">20.9</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">AA-LCR</td> <td align="center" style="vertical-align: middle; text-align: center">74.7</td> <td align="center" style="vertical-align: middle; text-align: center">70.0</td> <td align="center" style="vertical-align: middle; text-align: center">73.7</td> <td align="center" style="vertical-align: middle; text-align: center">67.7</td> <td align="center" style="vertical-align: middle; text-align: center">74.3</td> <td align="center" style="vertical-align: middle; text-align: center">71.3</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">HLE-Full</td> <td align="center" style="vertical-align: middle; text-align: center">43.5 / 56.0</td> <td align="center" style="vertical-align: middle; text-align: center">53.3 / 63.0</td> <td align="center" style="vertical-align: middle; text-align: center">44.5 / 58.0</td> <td align="center" style="vertical-align: middle; text-align: center">49.8 / 57.9</td> <td align="center" style="vertical-align: middle; text-align: center">41.4 / 52.2</td> <td align="center" style="vertical-align: middle; text-align: center">—</td> </tr> <tr> <td align="center" colspan="7" style="text-align: center"><strong>Coding</strong></td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">DeepSWE</td> <td align="center" style="vertical-align: middle; text-align: center">67.5</td> <td align="center" style="vertical-align: middle; text-align: center">70.0</td> <td align="center" style="vertical-align: middle; text-align: center">73.0</td> <td align="center" style="vertical-align: middle; text-align: center">59.0</td> <td align="center" style="vertical-align: middle; text-align: center">67.0</td> <td align="center" style="vertical-align: middle; text-align: center">46.2</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">ProgramBench</td> <td align="center" style="vertical-align: middle; text-align: center">77.8</td> <td align="center" style="vertical-align: middle; text-align: center">76.8</td> <td align="center" style="vertical-align: middle; text-align: center">77.6</td> <td align="center" style="vertical-align: middle; text-align: center">71.9</td> <td align="center" style="vertical-align: middle; text-align: center">70.8</td> <td align="center" style="vertical-align: middle; text-align: center">63.7</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">Terminal-Bench 2.1</td> <td align="center" style="vertical-align: middle; text-align: center">88.3</td> <td align="center" style="vertical-align: middle; text-align: center">88.0</td> <td align="center" style="vertical-align: middle; text-align: center">88.8</td> <td align="center" style="vertical-align: middle; text-align: center">84.6</td> <td align="center" style="vertical-align: middle; text-align: center">83.4</td> <td align="center" style="vertical-align: middle; text-align: center">82.7</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">FrontierSWE</td> <td align="center" style="vertical-align: middle; text-align: center">81.2</td> <td align="center" style="vertical-align: middle; text-align: center">86.6</td> <td align="center" style="vertical-align: middle; text-align: center">71.3</td> <td align="center" style="vertical-align: middle; text-align: center">66.7</td> <td align="center" style="vertical-align: middle; text-align: center">64.9</td> <td align="center" style="vertical-align: middle; text-align: center">67.3</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">SWE-Marathon</td> <td align="center" style="vertical-align: middle; text-align: center">42.0</td> <td align="center" style="vertical-align: middle; text-align: center">35.0</td> <td align="center" style="vertical-align: middle; text-align: center">39.0</td> <td align="center" style="vertical-align: middle; text-align: center">40.0</td> <td align="center" style="vertical-align: middle; text-align: center">14.0</td> <td align="center" style="vertical-align: middle; text-align: center">13.0</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">PostTrainBench</td> <td align="center" style="vertical-align: middle; text-align: center">36.6</td> <td align="center" style="vertical-align: middle; text-align: center">41.4</td> <td align="center" style="vertical-align: middle; text-align: center">34.6</td> <td align="center" style="vertical-align: middle; text-align: center">34.1</td> <td align="center" style="vertical-align: middle; text-align: center">28.4</td> <td align="center" style="vertical-align: middle; text-align: center">34.3</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">MLS-Bench-Lite</td> <td align="center" style="vertical-align: middle; text-align: center">48.3</td> <td align="center" style="vertical-align: middle; text-align: center">49.9</td> <td align="center" style="vertical-align: middle; text-align: center">46.2</td> <td align="center" style="vertical-align: middle; text-align: center">42.8</td> <td align="center" style="vertical-align: middle; text-align: center">35.5</td> <td align="center" style="vertical-align: middle; text-align: center">40.4</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">SciCode</td> <td align="center" style="vertical-align: middle; text-align: center">58.7</td> <td align="center" style="vertical-align: middle; text-align: center">60.2</td> <td align="center" style="vertical-align: middle; text-align: center">56.1</td> <td align="center" style="vertical-align: middle; text-align: center">53.5</td> <td align="center" style="vertical-align: middle; text-align: center">56.1</td> <td align="center" style="vertical-align: middle; text-align: center">50.5</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">Kimi Code Bench 2.0</td> <td align="center" style="vertical-align: middle; text-align: center">72.9</td> <td align="center" style="vertical-align: middle; text-align: center">76.9</td> <td align="center" style="vertical-align: middle; text-align: center">64.8</td> <td align="center" style="vertical-align: middle; text-align: center">71.7</td> <td align="center" style="vertical-align: middle; text-align: center">69.0</td> <td align="center" style="vertical-align: middle; text-align: center">64.2</td> </tr> <tr> <td align="center" colspan="7" style="text-align: center"><strong>Agentic</strong></td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">BrowseComp</td> <td align="center" style="vertical-align: middle; text-align: center">91.2</td> <td align="center" style="vertical-align: middle; text-align: center">88.0</td> <td align="center" style="vertical-align: middle; text-align: center">90.4</td> <td align="center" style="vertical-align: middle; text-align: center">84.3</td> <td align="center" style="vertical-align: middle; text-align: center">84.4</td> <td align="center" style="vertical-align: middle; text-align: center">—</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">DeepSearchQA (F1)</td> <td align="center" style="vertical-align: middle; text-align: center">95.0</td> <td align="center" style="vertical-align: middle; text-align: center">94.2</td> <td align="center" style="vertical-align: middle; text-align: center">—</td> <td align="center" style="vertical-align: middle; text-align: center">93.1</td> <td align="center" style="vertical-align: middle; text-align: center">—</td> <td align="center" style="vertical-align: middle; text-align: center">—</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">ResearchRubrics</td> <td align="center" style="vertical-align: middle; text-align: center">76.2</td> <td align="center" style="vertical-align: middle; text-align: center">—</td> <td align="center" style="vertical-align: middle; text-align: center">73.8</td> <td align="center" style="vertical-align: middle; text-align: center">73.5</td> <td align="center" style="vertical-align: middle; text-align: center">64.0</td> <td align="center" style="vertical-align: middle; text-align: center">71.1</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">GDPval-AA v2 (Elo)</td> <td align="center" style="vertical-align: middle; text-align: center">1686</td> <td align="center" style="vertical-align: middle; text-align: center">1747</td> <td align="center" style="vertical-align: middle; text-align: center">1736</td> <td align="center" style="vertical-align: middle; text-align: center">1593</td> <td align="center" style="vertical-align: middle; text-align: center">1491</td> <td align="center" style="vertical-align: middle; text-align: center">1510</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">Toolathlon-Verified</td> <td align="center" style="vertical-align: middle; text-align: center">76.5</td> <td align="center" style="vertical-align: middle; text-align: center">77.9</td> <td align="center" style="vertical-align: middle; text-align: center">74.9</td> <td align="center" style="vertical-align: middle; text-align: center">76.2</td> <td align="center" style="vertical-align: middle; text-align: center">73.5</td> <td align="center" style="vertical-align: middle; text-align: center">59.9</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">MCPMark-Verified</td> <td align="center" style="vertical-align: middle; text-align: center">94.5</td> <td align="center" style="vertical-align: middle; text-align: center">87.4</td> <td align="center" style="vertical-align: middle; text-align: center">92.9</td> <td align="center" style="vertical-align: middle; text-align: center">76.4</td> <td align="center" style="vertical-align: middle; text-align: center">92.9</td> <td align="center" style="vertical-align: middle; text-align: center">—</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">MCP-Atlas</td> <td align="center" style="vertical-align: middle; text-align: center">84.2</td> <td align="center" style="vertical-align: middle; text-align: center">84.7</td> <td align="center" style="vertical-align: middle; text-align: center">83.6</td> <td align="center" style="vertical-align: middle; text-align: center">83.6</td> <td align="center" style="vertical-align: middle; text-align: center">82.8</td> <td align="center" style="vertical-align: middle; text-align: center">82.6</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">AutomationBench</td> <td align="center" style="vertical-align: middle; text-align: center">30.8</td> <td align="center" style="vertical-align: middle; text-align: center">29.1</td> <td align="center" style="vertical-align: middle; text-align: center">29.7</td> <td align="center" style="vertical-align: middle; text-align: center">27.2</td> <td align="center" style="vertical-align: middle; text-align: center">22.7</td> <td align="center" style="vertical-align: middle; text-align: center">12.9</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">JobBench</td> <td align="center" style="vertical-align: middle; text-align: center">54.3</td> <td align="center" style="vertical-align: middle; text-align: center">57.4</td> <td align="center" style="vertical-align: middle; text-align: center">45.4</td> <td align="center" style="vertical-align: middle; text-align: center">48.4</td> <td align="center" style="vertical-align: middle; text-align: center">38.3</td> <td align="center" style="vertical-align: middle; text-align: center">43.4</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">AA-Briefcase (Elo)</td> <td align="center" style="vertical-align: middle; text-align: center">1548</td> <td align="center" style="vertical-align: middle; text-align: center">1583</td> <td align="center" style="vertical-align: middle; text-align: center">1495</td> <td align="center" style="vertical-align: middle; text-align: center">1354</td> <td align="center" style="vertical-align: middle; text-align: center">1158</td> <td align="center" style="vertical-align: middle; text-align: center">1260</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">Agents' Last Exam</td> <td align="center" style="vertical-align: middle; text-align: center">28.3</td> <td align="center" style="vertical-align: middle; text-align: center">25.7 <sup>†</sup></td> <td align="center" style="vertical-align: middle; text-align: center">29.6</td> <td align="center" style="vertical-align: middle; text-align: center">27.0</td> <td align="center" style="vertical-align: middle; text-align: center">26.6</td> <td align="center" style="vertical-align: middle; text-align: center">20.4</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">APEX-Agents</td> <td align="center" style="vertical-align: middle; text-align: center">41.0</td> <td align="center" style="vertical-align: middle; text-align: center">43.3</td> <td align="center" style="vertical-align: middle; text-align: center">39.9</td> <td align="center" style="vertical-align: middle; text-align: center">39.4</td> <td align="center" style="vertical-align: middle; text-align: center">38.5</td> <td align="center" style="vertical-align: middle; text-align: center">35.6</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">OfficeQA Pro</td> <td align="center" style="vertical-align: middle; text-align: center">63.3</td> <td align="center" style="vertical-align: middle; text-align: center">69.9</td> <td align="center" style="vertical-align: middle; text-align: center">63.2</td> <td align="center" style="vertical-align: middle; text-align: center">63.9</td> <td align="center" style="vertical-align: middle; text-align: center">60.9</td> <td align="center" style="vertical-align: middle; text-align: center">41.4</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">SpreadsheetBench 2</td> <td align="center" style="vertical-align: middle; text-align: center">34.8</td> <td align="center" style="vertical-align: middle; text-align: center">34.7</td> <td align="center" style="vertical-align: middle; text-align: center">32.4</td> <td align="center" style="vertical-align: middle; text-align: center">31.6</td> <td align="center" style="vertical-align: middle; text-align: center">29.1</td> <td align="center" style="vertical-align: middle; text-align: center">28.1</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">OSWorld-Verified</td> <td align="center" style="vertical-align: middle; text-align: center">84.8</td> <td align="center" style="vertical-align: middle; text-align: center">85.0</td> <td align="center" style="vertical-align: middle; text-align: center">83.0</td> <td align="center" style="vertical-align: middle; text-align: center">83.4</td> <td align="center" style="vertical-align: middle; text-align: center">79.0</td> <td align="center" style="vertical-align: middle; text-align: center">—</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">OSWorld 2.0</td> <td align="center" style="vertical-align: middle; text-align: center">58.3</td> <td align="center" style="vertical-align: middle; text-align: center">66.1</td> <td align="center" style="vertical-align: middle; text-align: center">62.6</td> <td align="center" style="vertical-align: middle; text-align: center">55.7</td> <td align="center" style="vertical-align: middle; text-align: center">49.5</td> <td align="center" style="vertical-align: middle; text-align: center">—</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">SaaS-Bench</td> <td align="center" style="vertical-align: middle; text-align: center">60.1</td> <td align="center" style="vertical-align: middle; text-align: center">—</td> <td align="center" style="vertical-align: middle; text-align: center">61.4</td> <td align="center" style="vertical-align: middle; text-align: center">56.1</td> <td align="center" style="vertical-align: middle; text-align: center">43.8</td> <td align="center" style="vertical-align: middle; text-align: center">—</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">τ³-Banking</td> <td align="center" style="vertical-align: middle; text-align: center">33.4</td> <td align="center" style="vertical-align: middle; text-align: center">26.8</td> <td align="center" style="vertical-align: middle; text-align: center">33.0</td> <td align="center" style="vertical-align: middle; text-align: center">27.6</td> <td align="center" style="vertical-align: middle; text-align: center">31.3</td> <td align="center" style="vertical-align: middle; text-align: center">26.8</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">Harvey Lab-AA</td> <td align="center" style="vertical-align: middle; text-align: center">94.6</td> <td align="center" style="vertical-align: middle; text-align: center">93.6</td> <td align="center" style="vertical-align: middle; text-align: center">87.2</td> <td align="center" style="vertical-align: middle; text-align: center">91.1</td> <td align="center" style="vertical-align: middle; text-align: center">86.3</td> <td align="center" style="vertical-align: middle; text-align: center">91.0</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">CorpFin v2</td> <td align="center" style="vertical-align: middle; text-align: center">71.6</td> <td align="center" style="vertical-align: middle; text-align: center">71.8</td> <td align="center" style="vertical-align: middle; text-align: center">64.4</td> <td align="center" style="vertical-align: middle; text-align: center">66.7</td> <td align="center" style="vertical-align: middle; text-align: center">68.4</td> <td align="center" style="vertical-align: middle; text-align: center">66.1</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">Finance Agent v2</td> <td align="center" style="vertical-align: middle; text-align: center">54.4</td> <td align="center" style="vertical-align: middle; text-align: center">56.3</td> <td align="center" style="vertical-align: middle; text-align: center">53.8</td> <td align="center" style="vertical-align: middle; text-align: center">53.9</td> <td align="center" style="vertical-align: middle; text-align: center">51.8</td> <td align="center" style="vertical-align: middle; text-align: center">49.7</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">Legal Research Bench</td> <td align="center" style="vertical-align: middle; text-align: center">44.2</td> <td align="center" style="vertical-align: middle; text-align: center">49.5</td> <td align="center" style="vertical-align: middle; text-align: center">48.1</td> <td align="center" style="vertical-align: middle; text-align: center">43.8</td> <td align="center" style="vertical-align: middle; text-align: center">40.4</td> <td align="center" style="vertical-align: middle; text-align: center">31.3</td> </tr> <tr> <td align="center" colspan="7" style="text-align: center"><strong>Vision</strong></td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">WorldVQA ForceAnswer</td> <td align="center" style="vertical-align: middle; text-align: center">51.0</td> <td align="center" style="vertical-align: middle; text-align: center">56.7</td> <td align="center" style="vertical-align: middle; text-align: center">41.8</td> <td align="center" style="vertical-align: middle; text-align: center">39.1</td> <td align="center" style="vertical-align: middle; text-align: center">38.5</td> <td align="center" style="vertical-align: middle; text-align: center">—</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">OmniDocBench</td> <td align="center" style="vertical-align: middle; text-align: center">91.1</td> <td align="center" style="vertical-align: middle; text-align: center">89.8</td> <td align="center" style="vertical-align: middle; text-align: center">85.8</td> <td align="center" style="vertical-align: middle; text-align: center">87.9</td> <td align="center" style="vertical-align: middle; text-align: center">89.4</td> <td align="center" style="vertical-align: middle; text-align: center">—</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">PerceptionBench</td> <td align="center" style="vertical-align: middle; text-align: center">58.5</td> <td align="center" style="vertical-align: middle; text-align: center">57.2</td> <td align="center" style="vertical-align: middle; text-align: center">59.7</td> <td align="center" style="vertical-align: middle; text-align: center">47.2</td> <td align="center" style="vertical-align: middle; text-align: center">55.8</td> <td align="center" style="vertical-align: middle; text-align: center">—</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">Video-MME (w. sub)</td> <td align="center" style="vertical-align: middle; text-align: center">90.0</td> <td align="center" style="vertical-align: middle; text-align: center">—</td> <td align="center" style="vertical-align: middle; text-align: center">89.5</td> <td align="center" style="vertical-align: middle; text-align: center">86.0</td> <td align="center" style="vertical-align: middle; text-align: center">89.3</td> <td align="center" style="vertical-align: middle; text-align: center">—</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">MMVU</td> <td align="center" style="vertical-align: middle; text-align: center">82.1</td> <td align="center" style="vertical-align: middle; text-align: center">—</td> <td align="center" style="vertical-align: middle; text-align: center">81.2</td> <td align="center" style="vertical-align: middle; text-align: center">79.2</td> <td align="center" style="vertical-align: middle; text-align: center">81.7</td> <td align="center" style="vertical-align: middle; text-align: center">—</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">BabyVision w/ python</td> <td align="center" style="vertical-align: middle; text-align: center">85.7</td> <td align="center" style="vertical-align: middle; text-align: center">90.5</td> <td align="center" style="vertical-align: middle; text-align: center">88.9</td> <td align="center" style="vertical-align: middle; text-align: center">81.2</td> <td align="center" style="vertical-align: middle; text-align: center">83.6</td> <td align="center" style="vertical-align: middle; text-align: center">—</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">MMMU-Pro</td> <td align="center" style="vertical-align: middle; text-align: center">81.6 / 83.4</td> <td align="center" style="vertical-align: middle; text-align: center">81.2 / 86.5</td> <td align="center" style="vertical-align: middle; text-align: center">83.0 / 84.6</td> <td align="center" style="vertical-align: middle; text-align: center">78.9 / 82.7</td> <td align="center" style="vertical-align: middle; text-align: center">81.2 / 83.2</td> <td align="center" style="vertical-align: middle; text-align: center">—</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">CharXiv (RQ)</td> <td align="center" style="vertical-align: middle; text-align: center">84.8 / 91.3</td> <td align="center" style="vertical-align: middle; text-align: center">88.9 / 93.5</td> <td align="center" style="vertical-align: middle; text-align: center">84.6 / 89.1</td> <td align="center" style="vertical-align: middle; text-align: center">80.5 / 89.9</td> <td align="center" style="vertical-align: middle; text-align: center">84.1 / 89.0</td> <td align="center" style="vertical-align: middle; text-align: center">—</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">MathVision</td> <td align="center" style="vertical-align: middle; text-align: center">94.3 / 97.8</td> <td align="center" style="vertical-align: middle; text-align: center">94.8 / 98.6</td> <td align="center" style="vertical-align: middle; text-align: center">95.8 / 97.8</td> <td align="center" style="vertical-align: middle; text-align: center">86.7 / 97.1</td> <td align="center" style="vertical-align: middle; text-align: center">92.2 / 96.8</td> <td align="center" style="vertical-align: middle; text-align: center">—</td> </tr> <tr> <td align="center" style="vertical-align: middle; text-align: center">ZeroBench (pass@5)</td> <td align="center" style="vertical-align: middle; text-align: center">23.0 / 41.0</td> <td align="center" style="vertical-align: middle; text-align: center">23.0 / 46.0</td> <td align="center" style="vertical-align: middle; text-align: center">17.0 / 35.0</td> <td align="center" style="vertical-align: middle; text-align: center">17.0 / 34.0</td> <td align="center" style="vertical-align: middle; text-align: center">22.0 / 41.0</td> <td align="center" style="vertical-align: middle; text-align: center">—</td> </tr> </tbody> </table> </div> <details> <summary><b>Evaluation Footnotes (inherited from base model)</b></summary>[!IMPORTANT] All benchmark scores in this section were reported for the base Kimi K3 model by its original developers. No independent evaluation campaign has been conducted on this abliterated variant. These results are reproduced as an upper-bound reference for inherited capability. Abliteration targets refusal behavior and is not expected to materially alter benchmark performance, but users should validate task-specific accuracy independently before relying on this variant in production or research settings.
All Kimi K3 results are obtained with reasoning effort set to max and temperature = 1.0. For single-step tasks, such as GPQA Diamond, HLE-Full, and vision benchmarks without tools, top-p = 0.95; for agentic tasks, top-p = 1.0. For HLE-Full, MMMU-Pro, CharXiv (RQ), MathVision, and ZeroBench, each cell reports the scores without and with tool augmentation (general tools for HLE-Full, Python for the vision benchmarks), in that order.
Reasoning & knowledge benchmarks
Coding benchmarks
Agentic benchmarks
Multimodal benchmarks
This model inherits the quantization-aware training (QAT) configuration from the base Kimi K3 release. Quantization-aware training is applied from the SFT stage onward, using MXFP4 weights with MXFP8 activations for broad hardware compatibility. No separate post-training quantization step is required.
[!NOTE] SHS-Lab/Kimi-K3-Abliterated is an open-weight release intended for self-hosted deployment. There is no hosted API provided by SHS-Lab. The following inference engines are recommended for serving this model.
The model is compatible with the following inference engines:
[!NOTE] The engine references above point to the base-model serving guides. Configuration parameters (tensor parallelism, quantization flags, context length, expert parallelism) apply identically to this abliterated variant. Consult each engine's documentation for hardware-specific tuning.
vllm serve SHS-Lab/Kimi-K3-Abliterated \
--tensor-parallel-size 8 \
--trust-remote-code \
--max-model-len 1,048,576 \
--enable-auto-tool-choice \
--tool-call-parser kimi_k3
Thinking is always enabled. The model returns a reasoning_content field alongside the standard content response. Reasoning effort is controlled via the top-level reasoning_effort request parameter:
| Value | Behavior |
|---|---|
"low" | Minimal reasoning trace; faster responses |
"high" | Extended reasoning for complex tasks |
"max" (default) | Full-depth reasoning chain |
The base model was trained in preserved thinking history mode. In multi-turn or tool-use sessions, pass the complete assistant message — including reasoning_content and tool_calls — back into messages. Omitting the reasoning trace degrades coherence across turns.
import openai
client = openai.OpenAI(
base_url="http://localhost:8000/v1", # adjust to your serving endpoint
api_key="EMPTY",
)
def chat_with_preserved_thinking(client: openai.OpenAI, model_name: str):
messages = [
{
"role": "user",
"content": "Tell me three random numbers.",
},
{
"role": "assistant",
"reasoning_content": "I'll start by listing five numbers: 473, 921, 235, 215, 222, and I'll tell you the first three.",
"content": "473, 921, 235",
},
{
"role": "user",
"content": "What are the other two numbers you have in mind?",
},
]
response = client.chat.completions.create(
model=model_name,
messages=messages,
stream=False,
max_tokens=4096,
reasoning_effort="max",
)
print(f"reasoning: {response.choices[0].message.reasoning_content}")
return response.choices[0].message.content
result = chat_with_preserved_thinking(client, "SHS-Lab/Kimi-K3-Abliterated")
print(f"content: {result}")
from transformers import AutoModelForCausalLM, AutoTokenizer
MODEL_ID = "SHS-Lab/Kimi-K3-Abliterated"
tokenizer = AutoTokenizer.from_pretrained(MODEL_ID)
model = AutoModelForCausalLM.from_pretrained(
MODEL_ID,
torch_dtype="auto",
device_map="auto",
)
prompt = "Summarize the key differences between KDA and standard multi-head attention."
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
outputs = model.generate(
**inputs,
max_new_tokens=2048,
temperature=1.0,
top_p=0.95,
)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
from transformers import AutoProcessor, AutoModelForImageTextToText
MODEL_ID = "SHS-Lab/Kimi-K3-Abliterated"
processor = AutoProcessor.from_pretrained(MODEL_ID)
model = AutoModelForImageTextToText.from_pretrained(
MODEL_ID,
torch_dtype="auto",
device_map="auto",
)
messages = [
{
"role": "user",
"content": [
{"type": "image", "image": "https://example.com/diagram.png"},
{"type": "text", "text": "Describe the architecture shown in this diagram."},
],
}
]
inputs = processor.apply_chat_template(
messages,
add_generation_prompt=True,
return_tensors="pt",
).to(model.device)
outputs = model.generate(**inputs, max_new_tokens=1024)
print(processor.decode(outputs[0], skip_special_tokens=True))
This model is compatible with agentic coding frameworks that support the OpenAI-compatible chat completions API. Configure your preferred agent framework (e.g., Kimi Code CLI, OpenHands, Aider) to point at the serving endpoint and select SHS-Lab/Kimi-K3-Abliterated as the model identifier.
Both the model weights and any associated code are distributed under the Kimi K3 License, inherited from the base model. All terms, conditions, and restrictions of the original license apply to this derivative release. Users are responsible for ensuring compliance with the base license and any applicable local regulations before deployment.
This release is an independent derivative work produced by SHS-Lab. The base model architecture, pretrained weights, and original training were developed by Moonshot AI as part of the Kimi K3 project. We acknowledge the Kimi K3 team for releasing open frontier-scale weights and for the architectural innovations (KDA, AttnRes, Stable LatentMoE, MoonViT-V2) that make this derivative possible.
This repository is not affiliated with, endorsed by, or maintained by Moonshot AI. The abliteration procedure, documentation, and any variant-specific modifications are the sole responsibility of SHS-Lab.
Released by SHS-Lab for alignment research and controlled experimentation.
</div>