Downloads · 30 days
87
7% of all-time downloads
Qwen3.5-27B-exl3-8.00bpw
UnstableLlama/Qwen3.5-27B-exl3-8.00bpw
Qwen3.5-27B-exl3-8.00bpw is a machine learning model from UnstableLlama. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
<style @import url('https://fonts.googleapis.com/css2?family=JetBrains+Mono:wght@400;700&family=Inter:wght@400;700&display=swap');
All-time downloads
1.3K
Public
Parameters
14.4B
137 GB on disk
Likes
15
Public
Repo makeup
Click a slice to open those files.
.safetensors28.8 GB · 100%
Parameter types
How the weights are stored.
I1612.6B · 88%
Base models
Model card
From the Hugging Face model README
<style>
@import url('https://fonts.googleapis.com/css2?family=JetBrains+Mono:wght@400;700&family=Inter:wght@400;700&display=swap');
.dashboard-container {
font-family: 'Inter', sans-serif;
width: min(1500px, calc(100vw - 32px));
max-width: 100%;
margin: 0 auto;
box-sizing: border-box;
background-color: #1a1b1e;
background-image: radial-gradient(#2d2f34 1px, transparent 1px);
background-size: 20px 20px;
color: #e0e0e0;
padding: 40px 24px;
border: 1px solid #4a4d53;
border-radius: 12px;
box-shadow: 0 10px 30px rgba(0,0,0,0.5);
}
.dashboard-header {
margin-bottom: 35px;
}
.dashboard-header h1 {
font-family: 'JetBrains Mono', monospace;
color: #ffffff;
font-size: 1.6em;
margin: 0;
padding-left: 15px;
border-left: 4px solid #4dabf7;
}
.meta-tag {
font-family: 'JetBrains Mono', monospace;
font-size: 0.8em;
color: #4dabf7;
background: rgba(77, 171, 247, 0.1);
padding: 4px 12px;
border: 1px solid rgba(77, 171, 247, 0.3);
border-radius: 4px;
margin-top: 12px;
display: inline-block;
}
.content-panel {
background-color: #25262b;
border: 1px solid #4a4d53;
border-radius: 8px;
margin-bottom: 25px;
overflow: hidden;
}
.panel-title {
background-color: #4dabf7;
color: #000000;
padding: 8px 20px;
font-family: 'JetBrains Mono', monospace;
font-weight: 800;
font-size: 0.85em;
text-transform: uppercase;
letter-spacing: 1px;
}
.panel-body {
padding: 20px;
}
.repo-data-panel {
padding: 14px 10px;
}
.repo-data-body {
display: flex;
flex-direction: column;
align-items: center;
gap: 20px;
width: 100%;
--edge-gap: 8px;
}
.repo-graph {
display: block;
width: min(1440px, calc(100% - (var(--edge-gap) * 2)));
height: auto;
margin: 0 auto;
}
.table-wrapper {
display: inline-block;
margin: 0 auto;
border: 1px solid #666a73;
border-radius: 4px;
overflow: hidden;
max-width: calc(100% - (var(--edge-gap) * 2));
}
.data-table {
border-collapse: collapse;
font-family: 'JetBrains Mono', monospace;
font-size: 0.85em;
width: auto;
margin: 0;
}
.data-table th {
text-align: left;
color: #ffffff;
background-color: #2d2f34;
padding: 9px 12px;
border-bottom: 2px solid #666a73;
border-right: 1px solid #4a4d53;
}
.data-table td {
padding: 7px 12px;
border-bottom: 1px solid #4a4d53;
border-right: 1px solid #4a4d53;
}
.data-table tr td:last-child,
.data-table tr th:last-child {
border-right: none;
}
.data-table tr:last-child td {
border-bottom: none;
}
.data-table tr:hover td {
background-color: rgba(77, 171, 247, 0.05);
}
.link-style {
color: #4dabf7;
text-decoration: none;
}
.link-style:hover {
text-decoration: underline;
color: #ffffff;
}
.terminal-box {
background-color: #0c0d0e;
border: 1px solid #4a4d53;
border-radius: 6px;
padding: 18px;
font-family: 'JetBrains Mono', monospace;
font-size: 0.85em;
color: #cbd5e0;
}
</style>
<div class="dashboard-container">
<div class="dashboard-header">
<h1>Qwen / Qwen3.5-27B</h1>
<div class="meta-tag">QUANTIZED BY: UnstableLlama</div>
</div>
<div class="content-panel">
<div class="panel-title">Information</div>
<div class="panel-body">
exl3 quantizations of <b><a class="link-style" href="https://huggingface.co/Qwen/Qwen3.5-27B">Qwen3.5-27B</a></b> via
<b><a class="link-style" href="https://github.com/turboderp-org/exllamav3">exllamav3</a></b>.
<br/>
repo generated automatically with
<a class="link-style" href="https://github.com/UnstableLlama/ezexl3">ezexl3</a>.
</div>
</div>
<div class="content-panel">
<div class="panel-title">Repo Data</div>
<div class="panel-body repo-data-body repo-data-panel">
<img class="repo-graph" src="qwen_qwen3.5-27b.svg" alt="Quantization graph">
<div class="table-wrapper">
<table class="data-table">
<thead>
<tr>
<th>REVISION</th>
<th>GiB</th>
<th>KL DIV</th>
<th>PPL</th>
</tr>
</thead>
<tbody>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/Qwen3.5-27B-exl3-2.00bpw">2.00bpw</a></td>
<td>9.84</td>
<td>0.1746</td>
<td>7.6985</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/Qwen3.5-27B-exl3-2.10bpw">2.10bpw</a></td>
<td>10.09</td>
<td>0.1412</td>
<td>7.3885</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/Qwen3.5-27B-exl3-3.00bpw">3.00bpw</a></td>
<td>12.67</td>
<td>0.0422</td>
<td>6.9977</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/Qwen3.5-27B-exl3-3.10bpw">3.10bpw</a></td>
<td>12.92</td>
<td>0.0376</td>
<td>6.9582</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/Qwen3.5-27B-exl3-4.00bpw">4.00bpw</a></td>
<td>15.50</td>
<td>0.0170</td>
<td>6.9331</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/Qwen3.5-27B-exl3-5.00bpw">5.00bpw</a></td>
<td>18.34</td>
<td>0.0070</td>
<td>6.8840</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/Qwen3.5-27B-exl3-6.00bpw">6.00bpw</a></td>
<td>21.17</td>
<td>0.0032</td>
<td>6.8439</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/Qwen3.5-27B-exl3-8.00bpw">8.00bpw</a></td>
<td>26.83</td>
<td>0.0003</td>
<td>6.8605</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/Qwen/Qwen3.5-27B">bf16</a></td>
<td>51.75</td>
<td>0.0000</td>
<td>6.8598</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
<div class="content-panel">
<div class="panel-title">SVG Catbench</div>
<div class="panel-body repo-data-body repo-data-panel">
<table align="center">
<tr>
<td align="center">
<a href="catbench/2.10bpw.svg">
<img src="catbench/2.10bpw.svg" alt="2.10 bpw" width="160">
</a>
<div>2.10 bpw</div>
</td>
<td align="center">
<a href="catbench/3.00bpw.svg">
<img src="catbench/3.00bpw.svg" alt="3.00 bpw" width="160">
</a>
<div>3.00 bpw</div>
</td>
<td align="center">
<a href="catbench/3.10bpw.svg">
<img src="catbench/3.10bpw.svg" alt="3.10 bpw" width="160">
</a>
<div>3.10 bpw</div>
</td>
<td align="center">
<a href="catbench/4.00bpw.svg">
<img src="catbench/4.00bpw.svg" alt="4.00 bpw" width="160">
</a>
<div>4.00 bpw</div>
</td>
</tr>
<tr>
<td align="center">
<a href="catbench/5.00bpw.svg">
<img src="catbench/5.00bpw.svg" alt="5.00 bpw" width="160">
</a>
<div>5.00 bpw</div>
</td>
<td align="center">
<a href="catbench/6.00bpw.svg">
<img src="catbench/6.00bpw.svg" alt="6.00 bpw" width="160">
</a>
<div>6.00 bpw</div>
</td>
<td align="center">
<a href="catbench/8.00bpw.svg">
<img src="catbench/8.00bpw.svg" alt="8.00 bpw" width="160">
</a>
<div>8.00 bpw</div>
</td>
</tr>
</table>
</div>
</div>
<div class="content-panel">
<div class="panel-title">CLI Download</div>
<div class="panel-body">
<div class="terminal-box">
hf download UnstableLlama/Qwen3.5-27B-exl3-4.00bpw --local-dir ./Qwen3.5-27B-exl3-4.00bpw
</div>
</div>
</div>
</div>
- Type
- qwen3_5
- License
- apache-2.0
- Created
- Mar 3, 2026
- Updated
- Apr 3, 2026