MiniCPM5-2B-heretic

YourIdentity/MiniCPM5-2B-heretic

MiniCPM5-2B-heretic is a text generation model from YourIdentity. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

[!TIP] This model is reproducible! See the README in the reproduce directory for more information.

Downloads · 30 days

410

100% of all-time downloads

All-time downloads

410

Public

Parameters

2.5B

5 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors5 GB · 100%

At a glance

Task: Text Generation
Library: transformers
License: apache-2.0
Model type: llama
Access: Public
Created: Sep 19, 2026
Updated: Sep 19, 2026
SHA: 5c4d27a8

Try a prompt

Datasets

Model card

From the Hugging Face model README

This is a decensored version of openbmb/MiniCPM5-2B, made using Heretic v2.0.0.dev0

[!TIP] This model is reproducible!

See the README in the reproduce directory for more information.

Abliteration parameters

Parameter	Value
direction_index	per layer
attn.o_proj.max_weight	1.33
attn.o_proj.max_weight_position	30.13
attn.o_proj.min_weight	1.32
attn.o_proj.min_weight_distance	15.59
mlp.down_proj.max_weight	0.57
mlp.down_proj.max_weight_position	26.57
mlp.down_proj.min_weight	0.56
mlp.down_proj.min_weight_distance	9.00

Performance

Metric	This model	Original model (openbmb/MiniCPM5-2B)
Refusals	6/100	99/100
KL divergence	0.0307	0 (by definition)

<div align="center"> <img src="https://raw.githubusercontent.com/OpenBMB/MiniCPM/main/assets/minicpm_logo.png" width="500em" /> </div> <p align="center"> <a href="https://arxiv.org/pdf/2506.07900" target="_blank">MiniCPM Tech Report</a> | <a href="https://modelbest.feishu.cn/wiki/UtWxwcERfiRIpIkBOjuc3h9tn1D" target="_blank">MiniCPM Wiki(Chinese)</a> | <a href="https://github.com/OpenBMB/MiniCPM" target="_blank">GitHub Repo</a> | <a href="https://ultradata.openbmb.cn/" target="_blank">UltraData</a> | <a href="https://huggingface.co/spaces/openbmb/MiniCPM5-2B-Demo" target="_blank">Online Demo</a> </p> <p align="center"> English | <a href="https://huggingface.co/openbmb/MiniCPM5-2B/blob/main/README-cn.md" target="_blank">中文</a> </p>

Highlights

We are releasing MiniCPM5-2B, the second model in the MiniCPM5 series, following MiniCPM5-1B. It is a dense 2B Transformer that scales up the same training recipe, built for on-device, local deployment, and resource-constrained scenarios, reaching 2B-class open-source SOTA.

🏆 2B-class open-source SOTA: compared with strong open-source models of similar size, MiniCPM5-2B achieves SOTA performance within this comparison set. It remains competitive with 4B-class models overall, while showing its advantages over models of comparable size in coding, mathematics, long-context understanding, tool use, and agentic tasks.

<div id="capability-comparison-radar" class="radar-visual" role="img" aria-label="Capability radar chart comparing MiniCPM5-2B with 4B-class models. Each axis is normalized independently to 100 percent."> <style> #capability-comparison-radar { --foreground: #171717; display: block; width: 100%; max-width: 620px; margin: 0 auto; background: #fff; font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, "PingFang SC", "Hiragino Sans GB", "Microsoft YaHei", sans-serif; } #capability-comparison-radar svg { display: block; width: 100%; height: auto; background: #fff; } #capability-comparison-radar .title { fill: var(--foreground); font-size: 16px; font-weight: 600; letter-spacing: 0; } #capability-comparison-radar .axis-label { fill: #333; font-size: 12px; font-weight: 600; } #capability-comparison-radar .ring { fill: none; stroke: rgba(128,128,128,.18); stroke-width: .8; } #capability-comparison-radar .spoke { stroke: rgba(128,128,128,.25); stroke-width: .8; } #capability-comparison-radar .ring-label { fill: #8a8a8a; font-size: 9px; } #capability-comparison-radar .series { stroke-linejoin: round; } #capability-comparison-radar .series.primary { stroke-width: 2.4; } #capability-comparison-radar .legend-label { fill: #171717; font-size: 12px; font-weight: 600; } #capability-comparison-radar .legend-average { fill: #666; font-size: 11px; } #capability-comparison-radar .legend-swatch { rx: 3; } @media (max-width: 900px) { #capability-comparison-radar { overflow-x: auto; } #capability-comparison-radar svg { min-width: 620px; } } </style> <svg viewBox="0 0 680 560" aria-hidden="true"> <g transform="translate(-20 0)"> <text x="40" y="28" class="title" text-anchor="start">Capability Radar by Dimension</text> <polygon points="340.0,235.0 362.5,243.2 374.5,263.9 370.3,287.5 352.0,302.9 328.0,302.9 309.7,287.5 305.5,263.9 317.5,243.2" class="ring" stroke="rgba(128,128,128,.18)" stroke-width=".8"/> <text x="344.0" y="238.0" class="ring-label">20%</text> <polygon points="340.0,200.0 385.0,216.4 408.9,257.8 400.6,305.0 363.9,335.8 316.1,335.8 279.4,305.0 271.1,257.8 295.0,216.4" class="ring" stroke="rgba(128,128,128,.18)" stroke-width=".8"/> <text x="344.0" y="203.0" class="ring-label">40%</text> <polygon points="340.0,165.0 407.5,189.6 443.4,251.8 430.9,322.5 375.9,368.7 304.1,368.7 249.1,322.5 236.6,251.8 272.5,189.6" class="ring" stroke="rgba(128,128,128,.18)" stroke-width=".8"/> <text x="344.0" y="168.0" class="ring-label">60%</text> <polygon points="340.0,130.0 430.0,162.8 477.9,245.7 461.2,340.0 387.9,401.6 292.1,401.6 218.8,340.0 202.1,245.7 250.0,162.8" class="ring" stroke="rgba(128,128,128,.18)" stroke-width=".8"/> <text x="344.0" y="133.0" class="ring-label">80%</text> <polygon points="340.0,95.0 452.5,135.9 512.3,239.6 491.6,357.5 399.9,434.4 280.1,434.4 188.4,357.5 167.7,239.6 227.5,135.9" class="ring" stroke="rgba(29,111,208,.28)" stroke-width="1"/> <text x="344.0" y="98.0" class="ring-label">100%</text> <line x1="340" y1="270" x2="340.0" y2="95.0" class="spoke"/> <text x="340.0" y="63.5" class="axis-label" text-anchor="middle">Code Reasoning</text> <line x1="340" y1="270" x2="452.5" y2="135.9" class="spoke"/> <text x="472.7" y="111.8" class="axis-label" text-anchor="start">Math Reasoning</text> <line x1="340" y1="270" x2="512.3" y2="239.6" class="spoke"/> <text x="543.4" y="234.1" class="axis-label" text-anchor="start">Instruction Following</text> <line x1="340" y1="270" x2="491.6" y2="357.5" class="spoke"/> <text x="518.8" y="373.2" class="axis-label" text-anchor="start">General Knowledge</text> <line x1="340" y1="270" x2="399.9" y2="434.4" class="spoke"/> <text x="410.6" y="464.0" class="axis-label" text-anchor="start">Long Context</text> <line x1="340" y1="270" x2="280.1" y2="434.4" class="spoke"/> <text x="269.4" y="464.0" class="axis-label" text-anchor="end">Tool Use</text> <line x1="340" y1="270" x2="188.4" y2="357.5" class="spoke"/> <text x="161.2" y="373.3" class="axis-label" text-anchor="end">Coding Agent</text> <line x1="340" y1="270" x2="167.7" y2="239.6" class="spoke"/> <text x="136.6" y="234.1" class="axis-label" text-anchor="end">Search Agent</text> <line x1="340" y1="270" x2="227.5" y2="135.9" class="spoke"/> <text x="207.3" y="111.8" class="axis-label" text-anchor="end">General Agent</text> <polygon points="340.0,136.7 450.1,138.8 498.4,242.1 491.6,357.5 398.4,430.3 289.5,408.8 188.4,357.5 188.2,243.2 249.3,161.9" class="series" fill="#E85D4C" fill-opacity=".10" stroke="#E85D4C" stroke-width="1.5"/> <circle cx="340.0" cy="136.7" r="3" fill="#E85D4C"/> <circle cx="450.1" cy="138.8" r="3" fill="#E85D4C"/> <circle cx="498.4" cy="242.1" r="3" fill="#E85D4C"/> <circle cx="491.6" cy="357.5" r="3" fill="#E85D4C"/> <circle cx="398.4" cy="430.3" r="3" fill="#E85D4C"/> <circle cx="289.5" cy="408.8" r="3" fill="#E85D4C"/> <circle cx="188.4" cy="357.5" r="3" fill="#E85D4C"/> <circle cx="188.2" cy="243.2" r="3" fill="#E85D4C"/> <circle cx="249.3" cy="161.9" r="3" fill="#E85D4C"/> <polygon points="340.0,134.4 448.9,140.2 512.3,239.6 462.2,340.5 367.8,346.5 308.0,358.0 231.0,332.9 242.3,252.8 250.1,162.9" class="series" fill="#2A9D8F" fill-opacity=".10" stroke="#2A9D8F" stroke-width="1.5"/> <circle cx="340.0" cy="134.4" r="3" fill="#2A9D8F"/> <circle cx="448.9" cy="140.2" r="3" fill="#2A9D8F"/> <circle cx="512.3" cy="239.6" r="3" fill="#2A9D8F"/> <circle cx="462.2" cy="340.5" r="3" fill="#2A9D8F"/> <circle cx="367.8" cy="346.5" r="3" fill="#2A9D8F"/> <circle cx="308.0" cy="358.0" r="3" fill="#2A9D8F"/> <circle cx="231.0" cy="332.9" r="3" fill="#2A9D8F"/> <circle cx="242.3" cy="252.8" r="3" fill="#2A9D8F"/> <circle cx="250.1" cy="162.9" r="3" fill="#2A9D8F"/> <polygon points="340.0,189.3 411.4,184.9 502.9,241.3 455.3,336.6 356.7,315.9 288.5,411.4 320.8,281.1 266.8,257.1 298.8,220.9" class="series" fill="#E09F3E" fill-opacity=".10" stroke="#E09F3E" stroke-width="1.5"/> <circle cx="340.0" cy="189.3" r="3" fill="#E09F3E"/> <circle cx="411.4" cy="184.9" r="3" fill="#E09F3E"/> <circle cx="502.9" cy="241.3" r="3" fill="#E09F3E"/> <circle cx="455.3" cy="336.6" r="3" fill="#E09F3E"/> <circle cx="356.7" cy="315.9" r="3" fill="#E09F3E"/> <circle cx="288.5" cy="411.4" r="3" fill="#E09F3E"/> <circle cx="320.8" cy="281.1" r="3" fill="#E09F3E"/> <circle cx="266.8" cy="257.1" r="3" fill="#E09F3E"/> <circle cx="298.8" cy="220.9" r="3" fill="#E09F3E"/> <polygon points="340.0,95.0 452.5,135.9 499.8,241.8 476.2,348.7 399.9,434.4 280.1,434.4 220.0,339.3 167.7,239.6 227.5,135.9" class="series primary" fill="#1D6FD0" fill-opacity=".22" stroke="#1D6FD0" stroke-width="2.4"/> <circle cx="340.0" cy="95.0" r="3" fill="#1D6FD0"/> <circle cx="452.5" cy="135.9" r="3" fill="#1D6FD0"/> <circle cx="499.8" cy="241.8" r="3" fill="#1D6FD0"/> <circle cx="476.2" cy="348.7" r="3" fill="#1D6FD0"/> <circle cx="399.9" cy="434.4" r="3" fill="#1D6FD0"/> <circle cx="280.1" cy="434.4" r="3" fill="#1D6FD0"/> <circle cx="220.0" cy="339.3" r="3" fill="#1D6FD0"/> <circle cx="167.7" cy="239.6" r="3" fill="#1D6FD0"/> <circle cx="227.5" cy="135.9" r="3" fill="#1D6FD0"/> <rect x="40" y="490" width="18" height="18" class="legend-swatch" fill="#1D6FD0"/> <text x="66" y="504" class="legend-label">MiniCPM5-2B</text> <text x="66" y="520" class="legend-average">avg 53.9</text> <rect x="195" y="490" width="18" height="18" class="legend-swatch" fill="#E85D4C"/> <text x="221" y="504" class="legend-label">Qwen3.5-4B</text> <text x="221" y="520" class="legend-average">avg 51.1</text> <rect x="350" y="490" width="18" height="18" class="legend-swatch" fill="#2A9D8F"/> <text x="376" y="504" class="legend-label">granite-4.2-3B</text> <text x="376" y="520" class="legend-average">avg 42.7</text> <rect x="505" y="490" width="18" height="18" class="legend-swatch" fill="#E09F3E"/> <text x="531" y="504" class="legend-label">LFM2.5-2.6B</text> <text x="531" y="520" class="legend-average">avg 33.2</text> <text x="340" y="548" class="legend-average" text-anchor="middle">each axis: max = 100%</text> </g> </svg> </div>

📂 Open High-Quality Data: Alongside the model, we are releasing the high-quality training datasets behind it as part of the UltraData family: UltraX, a high-quality web pre-training dataset; UltraData-Code, featuring L0–L3 tiered code data management to drive a significant leap in coding capabilities; UltraData-SFT-Agent-2609, comprising 500K agent training samples to enhance comprehensive on-device agent capabilities; and UltraData-RL-2609, with 80K+ high-quality RL training samples covering mathematics, code, general knowledge, and long-context reasoning.

Model List

Use this directory to choose the model format that matches your runtime:

MiniCPM5-2B

MiniCPM5-2B · ModelScope · BF16 final release (post-trained with RL + OPD) 👈 you are here
MiniCPM5-2B-SFT · ModelScope · BF16 SFT-only checkpoint (before RL / OPD)
MiniCPM5-2B-Midtrain · ModelScope · BF16 mid-training checkpoint (before SFT)
MiniCPM5-2B-Base · ModelScope · BF16 base checkpoint (pre-training only)
MiniCPM5-2B-GGUF · ModelScope · GGUF for llama.cpp / Ollama / LM Studio
MiniCPM5-2B-MLX · ModelScope · MLX / 4bit for Apple Silicon
MiniCPM5-2B-GPTQ · ModelScope · GPTQ / 4bit quantized model
MiniCPM5-2B-DSpark · ModelScope · DSpark draft model for inference acceleration
MiniCPM5-2B-DSpark-GGUF · ModelScope · GGUF version of DSpark draft model
MiniCPM5-2B-LiteRT · ModelScope · the LiteRT-LM version of MiniCPM5-2B

MiniCPM5-1B

MiniCPM5-1B · ModelScope · BF16 final release (post-trained with RL + OPD)
MiniCPM5-1B-SFT · ModelScope · BF16 SFT-only checkpoint (before RL / OPD)
MiniCPM5-1B-Base · ModelScope · BF16 base checkpoint (pre-training only)
MiniCPM5-1B-GGUF · ModelScope · GGUF for llama.cpp / Ollama / LM Studio
MiniCPM5-1B-MLX · ModelScope · MLX / 4bit for Apple Silicon

Model Information

MiniCPM5-2B has the following features:

Type: Causal Language Model
Architecture: Standard LlamaForCausalLM
Number of Parameters: 2,516,756,480
Number of Non-Embedding Parameters: 1,981,982,720
Number of Layers: 42
Number of Attention Heads (GQA): 16 for Q and 2 for KV
Context Length: 131,072

Introduction

MiniCPM5-2B is the second model in the MiniCPM5 series. It is designed for local assistants, coding agents, tool-use workflows, and reasoning scenarios where a compact model is preferred. The model keeps a small deployment footprint while providing native long-context support.

Evaluation Results

We compare MiniCPM5-2B with strong open-source models in the same size class, including LFM2.5-2.6B, Qwen3.5-2B, and Gemma-4-E2B-it, while also listing larger models such as Qwen3.5-4B, granite-4.2-3B, Nemotron-3-Nano-4B, Gemma-4-E4B-it, and LFM2.5-8B-A1B for reference.

Within this comparison set, MiniCPM5-2B reaches 2B-class open-source SOTA with an average score of 53.9, and also exceeds all of the larger models included here (the highest is 51.1). Its advantages are most visible in code reasoning, math reasoning, long-context understanding, tool use, and multiple agentic tasks.

<div style="width:100%;max-width:1080px;margin:0 auto;padding:16px 0;background:#fff; font-family:-apple-system,BlinkMacSystemFont,'Segoe UI',Roboto,'PingFang SC', 'Hiragino Sans GB','Microsoft YaHei',sans-serif;color:#171717"> <h1 style="margin:0 0 14px;font-size:22px;font-weight:700;color:#1D6FD0; letter-spacing:0.02em">Evaluation Results of MiniCPM5-2B and Baselines</h1> <table class="vl-table" style="width:100%;margin:0;table-layout:fixed;border-collapse:collapse;font-size:13px;font-variant-numeric:tabular-nums"><thead><tr><th rowspan="2" style="padding:7px 5px;text-align:left;font-weight:600;border-bottom:2px solid #1D6FD0;color:#1D6FD0;width:18%"></th><th rowspan="2" style="padding:7px 4px;text-align:center;font-weight:600;border-bottom:2px solid #1D6FD0;color:#1D6FD0;font-size:12px;width:9.111%;background:rgba(29, 111, 208, 0.08);vertical-align:middle;word-break:normal;">MiniCPM5-2B</th><th colspan="3" style="padding:6px 4px;text-align:center;font-weight:600;color:#1D6FD0;font-size:13px;border-bottom:1px solid rgba(29, 111, 208, 0.2);border-left:1px solid rgba(29, 111, 208, 0.25);">2B-class Models</th><th colspan="5" style="padding:6px 4px;text-align:center;font-weight:600;color:#1D6FD0;font-size:13px;border-bottom:1px solid rgba(29, 111, 208, 0.2);border-left:1px solid rgba(29, 111, 208, 0.25);">4B-class Models</th></tr><tr><th style="padding:6px 4px;text-align:center;font-weight:500;border-bottom:2px solid #1D6FD0;color:#1D6FD0;font-size:11px;width:9.111%;border-left:1px solid rgba(29, 111, 208, 0.25);word-break:normal;vertical-align:middle;">LFM2.5-2.6B</th><th style="padding:6px 4px;text-align:center;font-weight:500;border-bottom:2px solid #1D6FD0;color:#1D6FD0;font-size:11px;width:9.111%;word-break:normal;vertical-align:middle;">Qwen3.5-2B</th><th style="padding:6px 4px;text-align:center;font-weight:500;border-bottom:2px solid #1D6FD0;color:#1D6FD0;font-size:11px;width:9.111%;word-break:normal;vertical-align:middle;">Gemma-4-E2B-it</th><th style="padding:6px 4px;text-align:center;font-weight:500;border-bottom:2px solid #1D6FD0;color:#1D6FD0;font-size:11px;width:9.111%;border-left:1px solid rgba(29, 111, 208, 0.25);word-break:normal;vertical-align:middle;">Qwen3.5-4B</th><th style="padding:6px 4px;text-align:center;font-weight:500;border-bottom:2px solid #1D6FD0;color:#1D6FD0;font-size:11px;width:9.111%;word-break:normal;vertical-align:middle;">granite-4.2-3B</th><th style="padding:6px 4px;text-align:center;font-weight:500;border-bottom:2px solid #1D6FD0;color:#1D6FD0;font-size:11px;width:9.111%;word-break:normal;vertical-align:middle;">Nemotron-3-Nano-4B</th><th style="padding:6px 4px;text-align:center;font-weight:500;border-bottom:2px solid #1D6FD0;color:#1D6FD0;font-size:11px;width:9.111%;word-break:normal;vertical-align:middle;">Gemma-4-E4B-it</th><th style="padding:6px 4px;text-align:center;font-weight:500;border-bottom:2px solid #1D6FD0;color:#1D6FD0;font-size:11px;width:9.111%;word-break:normal;vertical-align:middle;">LFM2.5-8B-A1B</th></tr></thead><tbody> <tr style="background:rgba(29, 111, 208, 0.03)"><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">Average</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;font-weight:600;"><strong style="color:#1D6FD0">53.9</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;font-weight:600;">33.2</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;font-weight:600;">28.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;font-weight:600;">24.6</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;font-weight:600;">51.1</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;font-weight:600;">42.7</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;font-weight:600;">32.6</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;font-weight:600;">31.2</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;font-weight:600;">28.4</td></tr> <tr><td colspan="10" style="padding:5px 10px;font-weight:600;color:#1D6FD0;border-bottom:1px solid rgba(29, 111, 208, 0.2);background:rgba(29, 111, 208, 0.14)">Code Reasoning</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">LiveCodeBench v6</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">69.1</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">42.1</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">20.2</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">42.9</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">56.4</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">58.9</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">50.7</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">53.9</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">39.8</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">LCB-Pro 25Q2 (Easy)</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">68.0</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">30.9</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">10.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">27.1</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">58.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">54.6</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">51.6</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">45.8</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">27.8</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">LCB-Pro 25Q2 (Medium)</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">17.5</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">0.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">0.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">0.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">7.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">5.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">5.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">1.8</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">0.0</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">OJBench</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">32.5</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">11.2</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">2.6</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">11.6</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">24.8</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">21.8</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">20.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">19.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">8.2</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">SciCode (wbg)</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">26.3</strong><sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">14.2<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">2.8<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">20.9<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">16.1<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">24.9<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">16.4<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">24.4<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">7.8<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td></tr> <tr><td colspan="10" style="padding:5px 10px;font-weight:600;color:#1D6FD0;border-bottom:1px solid rgba(29, 111, 208, 0.2);background:rgba(29, 111, 208, 0.14)">Math Reasoning</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">AIME 2025</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">86.5</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">41.9</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">29.6</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">31.7</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">78.8</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">79.4</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">56.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">37.1</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">46.0</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">AIME 2026</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">86.5</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">45.2</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">29.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">39.8</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">82.7</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">83.5</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">62.1</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">45.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">56.7</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">HMMT Feb 2026</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong>63.8</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">33.7</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">20.5</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">17.8</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">64.0</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">60.8</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">51.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">30.1</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">38.5</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">MATH-500</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong>94.6</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">89.6</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">85.8</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">85.4</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">99.0</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">97.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">91.6</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">88.2</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">93.2</td></tr> <tr><td colspan="10" style="padding:5px 10px;font-weight:600;color:#1D6FD0;border-bottom:1px solid rgba(29, 111, 208, 0.2);background:rgba(29, 111, 208, 0.14)">Instruction Following</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">IFBench</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong>66.3</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">59.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">46.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">25.7</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">59.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">73.0</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">58.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">28.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">51.0</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">IFEval</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;">86.7</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;"><strong>93.4</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">77.5</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">31.4</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">90.2</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">93.7</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">88.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">44.4</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">90.8</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">Multi-IF</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;">71.8</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">76.8</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">57.1</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">40.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">73.6</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">75.9</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">65.9</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">45.9</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">71.4</td></tr> <tr><td colspan="10" style="padding:5px 10px;font-weight:600;color:#1D6FD0;border-bottom:1px solid rgba(29, 111, 208, 0.2);background:rgba(29, 111, 208, 0.14)">General Knowledge</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">MMLU-Pro</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong>70.8</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">65.2</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">64.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">56.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">78.0</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">65.8</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">65.7</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">68.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">63.1</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">MMLU-Redux</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong>84.7</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">80.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">80.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">71.8</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">88.7</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">78.9</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">79.8</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">83.7</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">80.0</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">HLE</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong>8.9</strong><sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">6.2<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">2.6<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">4.8<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">9.9</strong><sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">6.6<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">4.9<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">3.8<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">6.9<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">GPQA-Diamond</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong>70.2</strong><sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">55.8<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">45.6<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">43.3<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">77.1</strong><sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">55.9<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">51.3<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">57.6<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">51.3<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">SuperGPQA</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong>40.8</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">26.2</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">38.6</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">30.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">52.8</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">39.9</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">37.8</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">38.7</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">34.5</td></tr> <tr><td colspan="10" style="padding:5px 10px;font-weight:600;color:#1D6FD0;border-bottom:1px solid rgba(29, 111, 208, 0.2);background:rgba(29, 111, 208, 0.14)">Long Context</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">AA-LCR</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong>59.0</strong><sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">5.3<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">28.7<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">17.0<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">61.0</strong><sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">24.3<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">17.3<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">33.0<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">0.0<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">NoLiMa</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">68.1</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">0.7</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">17.1</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">3.9</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">43.5</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">5.1</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">1.1</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">2.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">0.5</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">LongBenchPro</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong>44.8</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">23.7</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">8.2</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">42.2</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">58.4</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">34.8</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">27.9</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">53.5</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">19.6</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">LongBench v2</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong>43.7</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">30.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">24.9</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">33.2</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">47.3</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">36.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">32.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">42.7</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">30.4</td></tr> <tr><td colspan="10" style="padding:5px 10px;font-weight:600;color:#1D6FD0;border-bottom:1px solid rgba(29, 111, 208, 0.2);background:rgba(29, 111, 208, 0.14)">Tool Use</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">τ³-Bench Banking</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">20.8</strong><sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">7.2<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">2.1</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">3.9</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">6.8<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">5.6<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">1.2</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">4.1</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">3.4</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">τ²-Bench Telecom</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">97.1</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">90.4</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">69.0<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">20.8<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">92.1<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">40.9</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">28.1<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">20.8<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">16.1<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">BFCL v4</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">66.6</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">61.1</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">43.6</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">36.6</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">56.8</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">52.2</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">43.7</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">47.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">49.2</td></tr> <tr><td colspan="10" style="padding:5px 10px;font-weight:600;color:#1D6FD0;border-bottom:1px solid rgba(29, 111, 208, 0.2);background:rgba(29, 111, 208, 0.14)">Coding Agent</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">SWE-bench Verified</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">46.4</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">6.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">5.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">2.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">33.6</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">36.8</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">3.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">15.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">0.4</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">SWE-bench Pro</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong>14.4</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">0.6</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">0.8</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">0.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">28.2</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">12.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">0.1</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">3.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">0.4</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">Terminal-Bench v2.1</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong>8.6</strong><sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">4.5<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">3.0<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">0.4<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">25.8</strong><sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">13.9<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">3.8<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">1.9<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">1.9</td></tr> <tr><td colspan="10" style="padding:5px 10px;font-weight:600;color:#1D6FD0;border-bottom:1px solid rgba(29, 111, 208, 0.2);background:rgba(29, 111, 208, 0.14)">Search Agent</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">BrowseComp-ZH</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">43.5</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">9.8</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">18.2</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">4.7</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">39.6</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">21.1</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">3.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">7.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">13.2</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">BrowseComp Top100</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">39.7</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">13.7</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">19.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">6.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">33.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">19.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">4.7</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">6.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">9.7</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">GAIA Text-103</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">88.7</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">49.5</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">47.9</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">30.1</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">78.6</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">57.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">26.5</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">39.5</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">41.1</td></tr> <tr><td colspan="10" style="padding:5px 10px;font-weight:600;color:#1D6FD0;border-bottom:1px solid rgba(29, 111, 208, 0.2);background:rgba(29, 111, 208, 0.14)">General Agent</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">GDPval-AA v2</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">19.6</strong><sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">4.5</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">0.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">0.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">11.7</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">0.0<sup style="font-size:0.72em;opacity:0.7">&dagger;</sup></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">0.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">0.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">0.0</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">Claw-Gym</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong>59.2</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">19.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">25.5</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">31.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">51.6</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">60.0</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">33.7</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">37.9</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">2.7</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">WildClaw</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">23.9</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">10.2</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">9.2</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">8.9</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">17.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">20.0</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">8.9</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">14.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">4.5</td></tr> <tr><td class="benchmark-cell" style="padding:5px 5px;padding-left:14px;border-bottom:1px solid rgba(128, 128, 128, 0.15);"><div class="benchmark-capability" style="font-size:14px;font-weight:600;line-height:1.22;color:#171717">QwenClaw</div></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);background:rgba(29, 111, 208, 0.08);vertical-align:middle;font-size:14px;line-height:1.2;"><strong style="color:#1D6FD0">42.9</strong></td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">19.3</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">18.2</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">14.5</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);border-left:1px solid rgba(29, 111, 208, 0.25);vertical-align:middle;font-size:14px;line-height:1.2;">37.1</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">36.4</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">16.8</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">16.7</td><td style="padding:5px 3px;text-align:center;border-bottom:1px solid rgba(128, 128, 128, 0.15);vertical-align:middle;font-size:14px;line-height:1.2;">4.5</td></tr> </tbody></table> <p style="margin:6px 0 0;font-size:11px;line-height:1.55;opacity:0.75">1. <strong style="color:#1D6FD0">Blue bold</strong> indicates the best result across all models in the row (including 4B-class models); <strong>Black bold</strong> indicates the best result among 2B-class models.<br>2. Scores marked <sup style="font-size:0.72em;opacity:0.7">&dagger;</sup> come from the official Artificial Analysis release; all others are reproduced internally.</p> </div>

Training Recipe

The training of MiniCPM5-2B is a full-stack practice of UltraData Tiered Data Management, covering three stages: base training, mid-training, and post-training.

During base training, the model goes through stable training and decay training to build core language capability and training stability. It then enters mid-training to further strengthen target capabilities and adapt to the target data distribution. The training corpus is released alongside the model as Ultra-FineWeb, Ultra-FineWeb-L3, UltraX, UltraData-Code and UltraData-Math.

During post-training, we proceed in three steps: SFT, RL, and OPD. We first use 400B tokens of deep-thinking SFT to establish deep-thinking and general chat abilities; the SFT data is released as UltraData-SFT-2605 and the Agent SFT data is released as UltraData-SFT-Agent-2609. We then train specialized RL teachers for math, code, agentic tasks, writing, and related domains (with the corresponding data also open-sourced as UltraData-RL-2609), and use On-Policy Distillation (OPD) to distill these teachers back into one release model.

MiniCPM5-2B Training Recipe

What does RL + OPD bring?

RL + OPD is a key part of MiniCPM5-2B post-training. During the RL stage, we adopted the critic-based algorithm described in JustRL II, substantially improving training stability and achieving significant gains across multiple domains. On the benchmarks listed below, RL + OPD improves reasoning and general capabilities by an average of ↑10.96 points, and agentic capabilities by ↑6.96 points.

OPD merges the capabilities of 16 expert models produced by RL training, including 5 agentic expert models. At each response position, we compute the full-vocabulary reverse KL divergence between student and teacher logits as the advantage estimate, replacing the original verification-based advantage. OPD directly reuses the prompts used to train each RL teacher as distillation data, so no additional corpus construction is required.

MiniCPM5-2B RL + OPD Gains

Quickstart

[!Tip] We recommend using the following sets of sampling parameters for generation: temperature=1.0, top_p=0.95, min_p=0.0.

If you encounter repetitive outputs, try: temperature=1.0, top_p=0.95, min_p=0.0, repetition_penalty=1.05.

Please note that the support for sampling parameters varies according to inference frameworks.

vLLM

pip install "vllm>=0.21"
vllm serve openbmb/MiniCPM5-2B --port 8000

curl http://localhost:8000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "openbmb/MiniCPM5-2B",
    "messages": [{"role": "user", "content": "Who are you? Please briefly introduce yourself."}],
    "max_tokens": 128,
    "temperature": 1.0
  }'

SGLang

pip install "sglang[srt]>=0.5.16"
python -m sglang.launch_server --model-path openbmb/MiniCPM5-2B --port 30000

curl http://localhost:30000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "openbmb/MiniCPM5-2B",
    "messages": [{"role": "user", "content": "Who are you? Please briefly introduce yourself."}],
    "max_tokens": 128,
    "temperature": 1.0
  }'

Speculative decoding (DSpark): we also release MiniCPM5-2B-DSpark, a DSpark draft model trained for MiniCPM5-2B. Enable it in SGLang to accelerate decoding while keeping the target model's outputs unchanged:

python -m sglang.launch_server \
  --model-path openbmb/MiniCPM5-2B \
  --trust-remote-code \
  --speculative-algorithm DSPARK \
  --speculative-draft-model-path openbmb/MiniCPM5-2B-DSpark \
  --speculative-dspark-block-size 7 \
  --port 30000

Llama.cpp

llama-server -m MiniCPM5-2B-F16.gguf -a MiniCPM5-2B --port 8080 -ngl 99 -c 8192 --jinja

-c 8192 sets the context length. You can adjust this value as needed.

curl http://localhost:8080/v1/chat/completions \
    -H "Content-Type: application/json" \
    -d '{
        "model": "MiniCPM5-2B",
        "messages": [{"role": "user", "content": "1+1=?"}],
        "temperature": 1.0, "top_p": 0.95, "min_p": 0.0, "max_tokens": 256
    }'

In llama.cpp, the default min_p=0.05 can lead to repetitive output: it filters out tokens whose probability is below 5% of the highest-probability token, potentially discarding the exact tokens needed to break out of a repetition loop. To prevent this, we set min_p=0.0.

Transformers

pip install -U "transformers>=5.6" accelerate torch

from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "openbmb/MiniCPM5-2B"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    torch_dtype="auto",
    device_map="auto",
)
messages = [{"role": "user", "content": "Who are you? Please briefly introduce yourself."}]
inputs = tokenizer.apply_chat_template(
    messages,
    tokenize=True,
    add_generation_prompt=True,
    enable_thinking=True,
    return_dict=True,
    return_tensors="pt",
).to(model.device)
outputs = model.generate(**inputs, max_new_tokens=128)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:], skip_special_tokens=True))

Tool Calling

For tool / function calling, SGLang is the recommended backend. MiniCPM5-2B emits XML-style tool calls and SGLang's built-in minicpm5 parser converts them to OpenAI-compatible tool_calls natively:

python -m sglang.launch_server --model-path openbmb/MiniCPM5-2B --port 30000 \
    --tool-call-parser minicpm5      # or: --tool-call-parser auto

GitHub Cookbooks and Agent Skills

MiniCPM5-2B uses the standard LlamaForCausalLM architecture, so mainstream inference engines can load it directly: no custom kernels, no model-code fork. For step-by-step deployment and fine-tuning instructions, use the GitHub cookbooks below. Agent Skills are linked as GitHub resources for users working with Cursor / Claude Code style coding agents.

Deployment

Backend	Model format / use case	Cookbook	Agent Skill
Transformers	BF16 / FP16 local Python inference, GPU + CPU	transformers.md	minicpm5-deploy-transformers
vLLM	BF16 / FP16 OpenAI server	vllm.md	minicpm5-deploy-vllm
SGLang	BF16 / FP16 OpenAI server, recommended for tool calling	sglang.md	minicpm5-deploy-sglang
llama.cpp	GGUF local inference, CPU/GPU	llama_cpp.md	minicpm5-deploy-llama-cpp
Ollama	GGUF local on-device runtime	ollama.md	minicpm5-deploy-ollama
LM Studio	GGUF Mac desktop app and OpenAI server	lmstudio.md	minicpm5-deploy-lmstudio
MLX	MLX / 4bit local inference on Apple Silicon	mlx.md	minicpm5-deploy-mlx

The model card is truncated. Read the rest on Hugging Face.

Task: Text Generation
Library: transformers
Type: llama
License: apache-2.0
Languages: en, zh
Created: Sep 19, 2026
Updated: Sep 19, 2026