Downloads · 30 days
7
11% of all-time downloads
Qwen3.5-2B-exl3-5.00bpw
UnstableLlama/Qwen3.5-2B-exl3-5.00bpw
Qwen3.5-2B-exl3-5.00bpw is a machine learning model from UnstableLlama. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
<style @import url('https://fonts.googleapis.com/css2?family=JetBrains+Mono:wght@400;700&family=Inter:wght@400;700&display=swap');
All-time downloads
66
Public
Parameters
1.5B
17.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.9 GB · 99%
Parameter types
How the weights are stored.
I16619M · 42%
Base models
Model card
From the Hugging Face model README
<style>
@import url('https://fonts.googleapis.com/css2?family=JetBrains+Mono:wght@400;700&family=Inter:wght@400;700&display=swap');
.dashboard-container {
font-family: 'Inter', sans-serif;
width: min(1500px, calc(100vw - 32px));
max-width: 100%;
margin: 0 auto;
box-sizing: border-box;
background-color: #1a1b1e;
background-image: radial-gradient(#2d2f34 1px, transparent 1px);
background-size: 20px 20px;
color: #e0e0e0;
padding: 40px 24px;
border: 1px solid #4a4d53;
border-radius: 12px;
box-shadow: 0 10px 30px rgba(0,0,0,0.5);
}
.dashboard-header {
margin-bottom: 35px;
}
.dashboard-header h1 {
font-family: 'JetBrains Mono', monospace;
color: #ffffff;
font-size: 1.6em;
margin: 0;
padding-left: 15px;
border-left: 4px solid #4dabf7;
}
.meta-tag {
font-family: 'JetBrains Mono', monospace;
font-size: 0.8em;
color: #4dabf7;
background: rgba(77, 171, 247, 0.1);
padding: 4px 12px;
border: 1px solid rgba(77, 171, 247, 0.3);
border-radius: 4px;
margin-top: 12px;
display: inline-block;
}
.content-panel {
background-color: #25262b;
border: 1px solid #4a4d53;
border-radius: 8px;
margin-bottom: 25px;
overflow: hidden;
}
.panel-title {
background-color: #4dabf7;
color: #000000;
padding: 8px 20px;
font-weight: 800;
font-size: 0.85em;
text-transform: uppercase;
letter-spacing: 1px;
}
.panel-body {
padding: 20px;
}
.repo-data-panel {
padding: 14px 10px;
}
.repo-data-body {
display: flex;
flex-direction: column;
align-items: center;
gap: 20px;
width: 100%;
--edge-gap: 8px;
}
.repo-graph {
display: block;
width: min(1440px, calc(100% - (var(--edge-gap) * 2)));
height: auto;
margin: 0 auto;
}
.table-wrapper {
display: inline-block;
margin: 0 auto;
border: 1px solid #666a73;
border-radius: 4px;
overflow: hidden;
max-width: calc(100% - (var(--edge-gap) * 2));
}
.data-table {
border-collapse: collapse;
font-family: 'JetBrains Mono', monospace;
font-size: 0.85em;
width: auto;
margin: 0;
}
.data-table th {
text-align: left;
color: #ffffff;
background-color: #2d2f34;
padding: 9px 12px;
border-bottom: 2px solid #666a73;
border-right: 1px solid #4a4d53;
}
.data-table td {
padding: 7px 12px;
border-bottom: 1px solid #4a4d53;
border-right: 1px solid #4a4d53;
}
.data-table tr td:last-child,
.data-table tr th:last-child {
border-right: none;
}
.data-table tr:last-child td {
border-bottom: none;
}
.data-table tr:hover td {
background-color: rgba(77, 171, 247, 0.05);
}
.link-style {
color: #4dabf7;
text-decoration: none;
}
.link-style:hover {
text-decoration: underline;
color: #ffffff;
}
.terminal-box {
background-color: #0c0d0e;
border: 1px solid #4a4d53;
border-radius: 6px;
padding: 18px;
font-family: 'JetBrains Mono', monospace;
font-size: 0.85em;
color: #cbd5e0;
}
</style>
<div class="dashboard-container">
<div class="dashboard-header">
<h1>Qwen / Qwen3.5-2B</h1>
<div class="meta-tag">QUANTIZED BY: UnstableLlama</div>
</div>
<div class="content-panel">
<div class="panel-title">Information</div>
<div class="panel-body">
⚠️ Requires ExLlamaV3 v0.0.23 (or v0.0.22 `dev` branch)
<br/>
exl3 quantizations of <b><a class="link-style" href="https://huggingface.co/Qwen/Qwen3.5-2B">Qwen3.5-2B</a></b> via
<b><a class="link-style" href="https://github.com/turboderp-org/exllamav3">exllamav3</a></b>.
<br/>
repo generated automatically with
<a class="link-style" href="https://github.com/UnstableLlama/ezexl3">ezexl3</a>.
</div>
</div>
<div class="content-panel">
<div class="panel-title">Repo Data</div>
<div class="panel-body repo-data-body repo-data-panel">
<img class="repo-graph" src="qwen_qwen3.5-2b.svg" alt="Quantization graph">
<div class="table-wrapper">
<table class="data-table">
<thead>
<tr>
<th>REVISION</th>
<th>GiB</th>
<th>KL DIV</th>
<th>PPL</th>
</tr>
</thead>
<tbody>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/Qwen3.5-2B-exl3-2.10bpw">2.10bpw</a></td>
<td>2.26</td>
<td>0.2965</td>
<td>15.8161</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/Qwen3.5-2B-exl3-3.10bpw">3.10bpw</a></td>
<td>2.42</td>
<td>0.0593</td>
<td>13.1512</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/Qwen3.5-2B-exl3-4.00bpw">4.00bpw</a></td>
<td>2.56</td>
<td>0.0140</td>
<td>12.3285</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/Qwen3.5-2B-exl3-5.00bpw">5.00bpw</a></td>
<td>2.72</td>
<td>0.0041</td>
<td>12.2906</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/Qwen3.5-2B-exl3-6.00bpw">6.00bpw</a></td>
<td>2.88</td>
<td>0.0013</td>
<td>12.1723</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/Qwen3.5-2B-exl3-8.00bpw">8.00bpw</a></td>
<td>3.20</td>
<td>0.0004</td>
<td>12.1875</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/Qwen/Qwen3.5-2B">bf16</a></td>
<td>4.24</td>
<td>0.0000</td>
<td>12.1829</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
<div class="content-panel">
<div class="panel-title">CLI Download</div>
<div class="panel-body">
<div class="terminal-box">
hf download UnstableLlama/Qwen3.5-2B-exl3-4.00bpw --local-dir ./Qwen3.5-2B-exl3-4.00bpw
</div>
</div>
</div>
</div>
- Type
- qwen3_5
- License
- apache-2.0
- Created
- Apr 4, 2026
- Updated
- Apr 4, 2026