Pestle-27B-Ternary-GGUF

Doses-AI/Pestle-27B-Ternary-GGUF

Pestle-27B-Ternary-GGUF is a text generation model from Doses-AI. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.

Downloads · 30 days

156

6% of all-time downloads

All-time downloads

2.6K

Public

Repo size

9.4 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf9.4 GB · 100%

At a glance

Task: Text Generation
Library: gguf
License: apache-2.0
Access: Public
Created: Aug 7, 2026
Updated: Aug 16, 2026
SHA: 736c65ea

Try a prompt

Base models

Qwen/Qwen3.6-27B

Model card

From the Hugging Face model README

Pestle-27B-Ternary-GGUF

</div>

Run locally - Benchmarks - Whitepaper - Model details - Responsible use

A trained 27B ternary medical model: 6.75 GB weight payload, one 8.48 GB runnable GGUF.

8.2× weight compression vs Qwen3.6-27B FP16 at 96.48% median medical capability retention across 17 matched measures · 101.9% of MedGemma-27B’s medical mean · ~10 tok/s on an 18 GB M3 MacBook

vs IQ2_XXS: 10% smaller · ahead or tied on 9/12 shared text-medical metrics · 12% higher shared medical score/GB

Highlights

Full 27B-class model in one 8.48 GB GGUF.
Strong medical performance across clinical knowledge, biomedical QA, and pharmaceutical retrieval.
Runs locally with Mortar on Apple Silicon, NVIDIA CUDA, and CPU fallback.
Text generation, tool-capable chat templates, and optional vision input.
Apache 2.0 licensed.

Benchmarks

Only completed, validated Pestle runs are shown. All locally measured medical runs for Pestle, Qwen3.6-27B FP16, Bonsai-27B Ternary, and Qwen3.6-27B IQ2_XXS used thinking disabled with greedy decoding (temperature=0, top_p=1, top_k=0), no repetition penalty, and seed 20260805. Published external reference cells are identified separately.

Complete comparison matrix

The categorized launch tables and their recorded values are preserved below.

<h3>Text medical benchmark comparison</h3> <div style="width:100%;max-width:100%;margin:0;padding:0"> <table aria-label="Medical benchmark comparison" style="width:100%;max-width:100%;border-collapse:collapse;table-layout:fixed;font-size:14px"> <thead><tr> <th style="width:25%;padding:9px 3px;text-align:left;font-weight:700;border-bottom:2px solid #4f7d25;color:#4f7d25;overflow-wrap:anywhere;white-space:normal;font-size:13px">Benchmark</th> <th style="width:15%;padding:9px 3px;text-align:center;font-weight:700;border-bottom:2px solid #4f7d25;color:#4f7d25;overflow-wrap:anywhere;white-space:normal;font-size:13px">Pestle-27B-Ternary</th> <th style="width:15%;padding:9px 3px;text-align:center;font-weight:700;border-bottom:2px solid #4f7d25;color:#4f7d25;overflow-wrap:anywhere;white-space:normal;font-size:13px">Qwen3.6-27B<br/>FP16</th> <th style="width:15%;padding:9px 3px;text-align:center;font-weight:700;border-bottom:2px solid #4f7d25;color:#4f7d25;overflow-wrap:anywhere;white-space:normal;font-size:13px">MedGemma 27B<br/>FP16</th> <th style="width:15%;padding:9px 3px;text-align:center;font-weight:700;border-bottom:2px solid #4f7d25;color:#4f7d25;overflow-wrap:anywhere;white-space:normal;font-size:13px">Bonsai 27B<br/>Ternary</th> <th style="width:15%;padding:9px 3px;text-align:center;font-weight:700;border-bottom:2px solid #4f7d25;color:#4f7d25;overflow-wrap:anywhere;white-space:normal;font-size:13px">Qwen3.6-27B<br/>IQ2_XXS</th> </tr></thead> <tbody> <tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">BPW (nominal / deployed)</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15)">1.79 / 2.52</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15)">16.00 / 16.00</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15)">16.00 / 16.00</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15)">1.71 / 2.13</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15)">2.06 / 2.80</td> </tr> <tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">Runnable model artifact (GB)</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15)">8.48</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15)">55.56</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15)">54.02</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15)">7.17</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15)">9.39</td> </tr> <tr><td colspan="6" style="padding:8px 5px;font-weight:700;color:#4f7d25;border-bottom:1px solid rgba(111,165,55,0.24);background:rgba(111,165,55,0.12)">Clinical knowledge & reasoning</td></tr><tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">MedQA</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">89.79</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">93.87</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">89.8 best-of-5 / 87.7 zero-shot<br/><small style="font-size:12px;line-height:1.25">(text)</small></td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">78.24</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">89.40</td> </tr><tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">MedXpertQA</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">32.49</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">41.10</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">25.7<br/><small style="font-size:12px;line-height:1.25">(text)</small></td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">20.82</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">31.22</td> </tr><tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">MedMCQA</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">68.85</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">73.70</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">74.2<br/><small style="font-size:12px;line-height:1.25">(text)</small></td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">58.59</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">68.40</td> </tr><tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">MMLU Anatomy</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">86.67</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">92.59</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">83.7<br/><small style="font-size:12px;line-height:1.25">(text)</small></td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">68.15</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">84.44</td> </tr><tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">MMLU Clinical Knowledge</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">90.19</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">92.45</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">86.0<br/><small style="font-size:12px;line-height:1.25">(text)</small></td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">84.53</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">90.19</td> </tr><tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">MMLU College Biology</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">96.53</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">97.92</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">96.5<br/><small style="font-size:12px;line-height:1.25">(text)</small></td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">94.44</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">97.92</td> </tr><tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">MMLU College Medicine</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">89.60</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">90.17</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">86.1<br/><small style="font-size:12px;line-height:1.25">(text)</small></td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">84.39</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">88.44</td> </tr><tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">MMLU Medical Genetics</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">96.00</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">99.00</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">97.0<br/><small style="font-size:12px;line-height:1.25">(text)</small></td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">89.00</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">98.00</td> </tr><tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">MMLU Professional Medicine</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">94.85</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">95.96</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">93.4<br/><small style="font-size:12px;line-height:1.25">(text)</small></td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">88.97</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">93.38</td> </tr><tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">MMLU Virology</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">56.02</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">56.02</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">53.6<br/><small style="font-size:12px;line-height:1.25">(text)</small></td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">50.60</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">56.02</td> </tr> <tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">ChemBench</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">61.72</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">68.73</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">--</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">61.33</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">--</td> </tr> <tr><td colspan="6" style="padding:8px 5px;font-weight:700;color:#4f7d25;border-bottom:1px solid rgba(111,165,55,0.24);background:rgba(111,165,55,0.12)">Biomedical QA & Retrieval</td></tr><tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">PubMedQA (accuracy)</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">76.70</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">79.50</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">77.2<br/><small style="font-size:12px;line-height:1.25">(multimodal)</small></td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">77.70</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">78.30</td> </tr><tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">PubMedQA (macro F1)</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">62.78</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">64.61</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">--</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">62.17</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">57.74</td> </tr> <tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">BioASQ (token F1)</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">75.28</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">76.65</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">--</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">75.46</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">--</td> </tr> <tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">BioASQ (exact match)</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">55.94</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">59.49</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">--</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">54.12</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">--</td> </tr> <tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">PharmaRAG (MRR)</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">90.15</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">93.91</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">--</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">92.60</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">--</td> </tr> <tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">PharmaRAG (nDCG@10)</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">84.62</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">90.84</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">--</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">89.43</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">--</td> </tr> </tbody></table> </div> <sub>Size note: Pestle's trained weight payload is 6.75 GB before packaging as one 8,480,707,488-byte runnable GGUF. “Representation BPW” reports the underlying nominal or idealized low-bit representation: Pestle's 1.79-BPW low-bit base before its BF16 overlay, Bonsai's 1.71-BPW ideal ternary representation, and IQ2_XXS's 2.06-BPW quantized block format. “Effective BPW” and decimal GB use runnable or officially downloadable artifacts. Pestle's runnable GGUF equals 2.52 effective BPW over 26,895,998,464 text parameters. Qwen3.6-27B FP16 uses the official 55,562,855,904-byte safetensors payload; MedGemma 27B text FP16 uses 54,018,098,888 bytes across its official shards; Ternary Bonsai uses the downloadable 7,165,121,600-byte Q2_0 GGUF (2.13 deployed BPW); and IQ2_XXS uses the official 9,388,779,744-byte GGUF (2.79 effective BPW, displayed as 2.80).</sub>

Medical intelligence density

<p align="center"> <img src="pestle-27b-ternary-medical-intelligence-density.png" alt="Medical intelligence density comparison across Pestle-27B-Ternary, Qwen3.6-27B IQ2_XXS, Bonsai-27B Ternary, Qwen3.6-27B FP16, and MedGemma-27B FP16" width="66%"> </p> <p align="center"><sub>Medical intelligence density on 10 shared text-only medical benchmarks, defined as D = -log₂(1 - score/100) / downloadable GB. Pestle records <strong>0.275</strong> at 8.48 GB; Qwen3.6-27B IQ2_XXS records 0.245 at 9.39 GB; Bonsai-27B Ternary records 0.234 using a 7.79 GB package comprising its 7.17 GB GGUF and 0.63 GB optional Q8 vision projector; Qwen3.6-27B FP16 records 0.046 at 55.56 GB; and MedGemma-27B FP16 records 0.041 at 54.02 GB. Higher is better.</sub></p> <p align="center"><sub>Metric source: <a href="https://huggingface.co/prism-ml/Ternary-Bonsai-27B-gguf#intelligence-density">Prism ML's Bonsai</a>.</sub></p> <h3>General benchmark comparison</h3> <div style="width:100%;max-width:100%;margin:0;padding:0"> <table aria-label="General benchmark comparison" style="width:100%;max-width:100%;border-collapse:collapse;table-layout:fixed;font-size:14px"> <thead><tr> <th style="width:28%;padding:10px 5px;text-align:left;font-weight:700;border-bottom:2px solid #4f7d25;color:#4f7d25;overflow-wrap:anywhere;white-space:normal;font-size:15px">Benchmark</th> <th style="width:12%;padding:10px 5px;text-align:center;font-weight:700;border-bottom:2px solid #4f7d25;color:#4f7d25;overflow-wrap:anywhere;white-space:normal;font-size:15px">Pestle-27B-Ternary</th> <th style="width:12%;padding:10px 5px;text-align:center;font-weight:700;border-bottom:2px solid #4f7d25;color:#4f7d25;overflow-wrap:anywhere;white-space:normal;font-size:15px">Qwen3.6-27B<br/>FP16</th> <th style="width:12%;padding:10px 5px;text-align:center;font-weight:700;border-bottom:2px solid #4f7d25;color:#4f7d25;overflow-wrap:anywhere;white-space:normal;font-size:15px">Bonsai 27B<br/>Ternary</th> <th style="width:12%;padding:10px 5px;text-align:center;font-weight:700;border-bottom:2px solid #4f7d25;color:#4f7d25;overflow-wrap:anywhere;white-space:normal;font-size:15px">Qwen3.6-27B<br/>Q4_K_XL</th> <th style="width:12%;padding:10px 5px;text-align:center;font-weight:700;border-bottom:2px solid #4f7d25;color:#4f7d25;overflow-wrap:anywhere;white-space:normal;font-size:15px">Qwen3.6-27B<br/>IQ2_XXS</th> <th style="width:12%;padding:10px 5px;text-align:center;font-weight:700;border-bottom:2px solid #4f7d25;color:#4f7d25;overflow-wrap:anywhere;white-space:normal;font-size:15px">Gemma4-31B<br/>FP16</th> </tr></thead> <tbody> <tr><td colspan="7" style="padding:8px 5px;font-weight:700;color:#4f7d25;border-bottom:1px solid rgba(111,165,55,0.24);background:rgba(111,165,55,0.12)">Knowledge & reasoning</td></tr> <tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">MMLU-Redux</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">83.53</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">93.5</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">88.05</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">93.35</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">88.93</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">93.60</td> </tr> <tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">MuSR</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">70.50</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">72.88</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">65.87</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">73.01</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">66.99</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">71.03</td> </tr> <tr><td colspan="7" style="padding:8px 5px;font-weight:700;color:#4f7d25;border-bottom:1px solid rgba(111,165,55,0.24);background:rgba(111,165,55,0.12)">Math</td></tr> <tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">GSM8K</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">93.25</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">95.30</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">96.06</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">96.66</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">89.90</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">97.57</td> </tr> <tr><td colspan="7" style="padding:8px 5px;font-weight:700;color:#4f7d25;border-bottom:1px solid rgba(111,165,55,0.24);background:rgba(111,165,55,0.12)">Coding</td></tr> <tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">HumanEval+</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">87.20</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">95.12</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">93.90</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">95.73</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">91.46</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">96.34</td> </tr> <tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">MBPP+</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">83.33</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">83.33</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">81.22</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">83.86</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">78.89</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">84.39</td> </tr> <tr><td colspan="7" style="padding:8px 5px;font-weight:700;color:#4f7d25;border-bottom:1px solid rgba(111,165,55,0.24);background:rgba(111,165,55,0.12)">Instruction following</td></tr> <tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">IFEval (prompt-strict)</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">81.70</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">88.91</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">85.03</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">88.83</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">84.03</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);overflow-wrap:anywhere;white-space:normal">90.57</td> </tr> </tbody></table> </div> <p align="center"> <img src="pestle-27b-ternary-benchmark-landscape.png" alt="Pestle-27B-Ternary medical and general benchmark landscape" width="100%"> </p> <p align="center"><sub>Medical-text benchmarks are shown above broader capability context. Solid connections denote locally paired Pestle and Qwen FP16 measurements.</sub></p>

Experimental vision

Optional vision uses the separately downloaded projection file and is not included in the text-medical headline comparisons.

<div style="width:100%;max-width:100%;margin:0;padding:0"> <table aria-label="Experimental vision benchmark comparison" style="width:100%;max-width:100%;border-collapse:collapse;table-layout:fixed;font-size:14px"> <thead><tr> <th style="width:40%;padding:9px 5px;text-align:left;font-weight:700;border-bottom:2px solid #4f7d25;color:#4f7d25">Benchmark</th> <th style="width:20%;padding:9px 5px;text-align:center;font-weight:700;border-bottom:2px solid #4f7d25;color:#4f7d25">Pestle-27B-Ternary</th> <th style="width:20%;padding:9px 5px;text-align:center;font-weight:700;border-bottom:2px solid #4f7d25;color:#4f7d25">Qwen3.6-27B FP16</th> <th style="width:20%;padding:9px 5px;text-align:center;font-weight:700;border-bottom:2px solid #4f7d25;color:#4f7d25">MedGemma 27B FP16</th> </tr></thead> <tbody> <tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15)">CXR14 adjudicated (macro F1)</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15)">34.28</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15)">--</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15)">45.3 <small>(multimodal)</small></td> </tr> <tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15)">CheXpert expert validation (macro F1)</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15)">51.03</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15)">--</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15)">49.9 <small>(multimodal)</small></td> </tr> <tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15)">VQA-RAD (tokenized F1)</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15)">53.49</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15)">66.69</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15)">46.7 <small>(multimodal)</small></td> </tr> <tr> <td style="padding:8px 5px;text-align:left;font-weight:600;border-bottom:1px solid rgba(128,128,128,0.15)">SLAKE (tokenized F1)</td> <td style="padding:8px 5px;text-align:center;font-weight:700;color:#4f7d25;background:rgba(111,165,55,0.055);border-bottom:1px solid rgba(128,128,128,0.15)">54.81</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15)">76.60</td> <td style="padding:8px 5px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15)">70.3 <small>(multimodal)</small></td> </tr> </tbody></table> </div>

Deployment performance

Canonical generation protocol

Pestle results use thinking disabled, deterministic greedy decoding (temperature=0, top_p=1, top_k=0), no repetition penalty, and seed 20260805. The locally measured medical Qwen BF16, Bonsai, and IQ2_XXS comparison runs use the same non-thinking sampling protocol. Dataset-specific output ceilings and finish-state handling are documented in the technical report.

Model details

	Pestle-27B-Ternary
Base model	Qwen/Qwen3.6-27B
Architecture	Qwen3.6 (`qwen35` in GGUF metadata)
Parameters	26.9B text parameters
Format	Single-file Pestle ternary GGUF with a BF16 final decoder block
Representation / effective deployed BPW	1.79 / 2.52
Trained weight payload	6.75 GB before GGUF packaging
Runnable text artifact	`pestle-27b-ternary.gguf` (8.48 GB)
Training	Medical-domain optimization and knowledge distillation; one NVIDIA H100, approximately 40 hours
Context length	Up to 262K tokens; practical context depends on available memory
Chat template	Qwen3.6 template, embedded in the GGUF and published as `chat_template.jinja`
Inputs	Text; optional images with `mmproj-pestle-27b-ternary.gguf` (0.93 GB)
Hardware	Apple Silicon via Metal; NVIDIA GPUs via CUDA; CPU fallback
Runtime	Mortar, with a llama.cpp-compatible interface
License	Apache 2.0

The published GGUF is the complete runnable model. No separate overlay assembly or weight conversion is required.

Run locally

1. Download

hf auth login

hf download Doses-AI/Pestle-27B-Ternary-GGUF \
  pestle-27b-ternary.gguf \
  --local-dir models/Pestle-27B-Ternary

For optional vision input, download the matching projection too:

hf download Doses-AI/Pestle-27B-Ternary-GGUF \
  mmproj-pestle-27b-ternary.gguf \
  --local-dir models/Pestle-27B-Ternary

2. Build Mortar

git clone https://github.com/DosesAI/mortar.cpp.git
cd mortar.cpp
./scripts/build-mortar.sh

The build script selects Metal on macOS, CUDA on Linux when a compatible NVIDIA GPU is visible, and CPU otherwise.

For a CPU-only build on macOS or Linux:

./scripts/build-mortar.sh --cpu
./mortar --cpu-only \
  --model ../models/Pestle-27B-Ternary/pestle-27b-ternary.gguf

On Windows PowerShell:

.\scripts\build-mortar.ps1 -Backend cpu
.\mortar.ps1 --cpu-only `
  --model ..\models\Pestle-27B-Ternary\pestle-27b-ternary.gguf

CPU-only inference uses the same GGUF without conversion. It requires enough system RAM for the model and context and is substantially slower than Metal or CUDA inference.

3. Chat

./mortar \
  --model ../models/Pestle-27B-Ternary/pestle-27b-ternary.gguf

Or start with a prompt:

./mortar \
  --model ../models/Pestle-27B-Ternary/pestle-27b-ternary.gguf \
  --prompt "Explain the mechanism of action of metformin."

Mortar applies the validated Pestle runtime and deterministic defaults automatically.

Recommended generation settings

Setting	Value used for reported evaluations
Thinking	Off
Temperature	0
Top-p	1
Top-k	0
Repetition penalty	1
Seed	20260805

The model supports thinking mode; enable it only when desired and treat it as a different evaluation/deployment configuration.

Architecture

Pestle is a trained ternary medical model developed through Doses AI’s medical-domain optimization and knowledge distillation. It preserves the Qwen3.6-27B hybrid-attention architecture while applying Doses AI ternary compression across the language model. The release combines a compact ternary core with a matching-parent BF16 final decoder block and ships as a single runnable GGUF.

Optional vision input uses the separately downloadable matching projection file.

Intended use

Pestle is a research preview intended for evaluation and development of locally hosted medical-text, biomedical retrieval, pharmaceutical, coding, and general assistant systems. It is not released for clinical use.

Responsible use

Pestle is a research preview for evaluation and development. It is not a medical device and is not intended to make diagnosis, treatment, prescribing, triage, or patient-management decisions.

Outputs may be inaccurate, incomplete, biased, or confidently wrong.
Medical outputs require review by qualified professionals and validation for the intended setting.
Do not send identifiable patient information to an environment that is not approved to process it.
Local execution can support privacy and data-residency goals, but does not by itself establish regulatory compliance.
Long outputs can occasionally become repetitive; production systems should use sensible generation limits and monitoring.

Citation

@misc{dosesai2026pestle,
  title        = {Pestle-27B-Ternary},
  author       = {{Doses AI}},
  year         = {2026},
  howpublished = {Hugging Face model release},
  url          = {https://huggingface.co/Doses-AI/Pestle-27B-Ternary-GGUF}
}

Repo makeup

At a glance

Try a prompt

Base models

Model card

Pestle-27B-Ternary-GGUF

Highlights

Benchmarks

Complete comparison matrix

Medical intelligence density

Experimental vision

Deployment performance

Canonical generation protocol

Model details

Run locally

1. Download

2. Build Mortar

3. Chat

Recommended generation settings

Architecture

Intended use

Responsible use

Citation

Links