Downloads · 30 days
9
6% of all-time downloads
Qwen3.5-0.8B-exl3-6.00bpw
UnstableLlama/Qwen3.5-0.8B-exl3-6.00bpw
Qwen3.5-0.8B-exl3-6.00bpw is a machine learning model from UnstableLlama. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
<style @import url('https://fonts.googleapis.com/css2?family=JetBrains+Mono:wght@400;700&family=Inter:wght@400;700&display=swap');
All-time downloads
141
Public
Parameters
639M
1.3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.3 GB · 98%
Parameter types
How the weights are stored.
I16282M · 44%
Base models
Model card
From the Hugging Face model README
<style>
@import url('https://fonts.googleapis.com/css2?family=JetBrains+Mono:wght@400;700&family=Inter:wght@400;700&display=swap');
.dashboard-container {
font-family: 'Inter', sans-serif;
width: min(1500px, calc(100vw - 32px));
max-width: 100%;
margin: 0 auto;
box-sizing: border-box;
background-color: #1a1b1e;
background-image: radial-gradient(#2d2f34 1px, transparent 1px);
background-size: 20px 20px;
color: #e0e0e0;
padding: 40px 24px;
border: 1px solid #4a4d53;
border-radius: 12px;
box-shadow: 0 10px 30px rgba(0,0,0,0.5);
}
.dashboard-header {
margin-bottom: 35px;
}
.dashboard-header h1 {
font-family: 'JetBrains Mono', monospace;
color: #ffffff;
font-size: 1.6em;
margin: 0;
padding-left: 15px;
border-left: 4px solid #4dabf7;
}
.meta-tag {
font-family: 'JetBrains Mono', monospace;
font-size: 0.8em;
color: #4dabf7;
background: rgba(77, 171, 247, 0.1);
padding: 4px 12px;
border: 1px solid rgba(77, 171, 247, 0.3);
border-radius: 4px;
margin-top: 12px;
display: inline-block;
}
.content-panel {
background-color: #25262b;
border: 1px solid #4a4d53;
border-radius: 8px;
margin-bottom: 25px;
overflow: hidden;
}
.panel-title {
background-color: #4dabf7;
color: #000000;
padding: 8px 20px;
font-weight: 800;
font-size: 0.85em;
text-transform: uppercase;
letter-spacing: 1px;
}
.panel-body {
padding: 20px;
}
.repo-data-panel {
padding: 14px 10px;
}
.repo-data-body {
display: flex;
flex-direction: column;
align-items: center;
gap: 20px;
width: 100%;
--edge-gap: 8px;
}
.repo-graph {
display: block;
width: min(1440px, calc(100% - (var(--edge-gap) * 2)));
height: auto;
margin: 0 auto;
}
.table-wrapper {
display: inline-block;
margin: 0 auto;
border: 1px solid #666a73;
border-radius: 4px;
overflow: hidden;
max-width: calc(100% - (var(--edge-gap) * 2));
}
.data-table {
border-collapse: collapse;
font-family: 'JetBrains Mono', monospace;
font-size: 0.85em;
width: auto;
margin: 0;
}
.data-table th {
text-align: left;
color: #ffffff;
background-color: #2d2f34;
padding: 9px 12px;
border-bottom: 2px solid #666a73;
border-right: 1px solid #4a4d53;
}
.data-table td {
padding: 7px 12px;
border-bottom: 1px solid #4a4d53;
border-right: 1px solid #4a4d53;
}
.data-table tr td:last-child,
.data-table tr th:last-child {
border-right: none;
}
.data-table tr:last-child td {
border-bottom: none;
}
.data-table tr:hover td {
background-color: rgba(77, 171, 247, 0.05);
}
.link-style {
color: #4dabf7;
text-decoration: none;
}
.link-style:hover {
text-decoration: underline;
color: #ffffff;
}
.terminal-box {
background-color: #0c0d0e;
border: 1px solid #4a4d53;
border-radius: 6px;
padding: 18px;
font-family: 'JetBrains Mono', monospace;
font-size: 0.85em;
color: #cbd5e0;
}
</style>
<div class="dashboard-container">
<div class="dashboard-header">
<h1>Qwen / Qwen3.5-0.8B</h1>
<div class="meta-tag">QUANTIZED BY: UnstableLlama</div>
</div>
<div class="content-panel">
<div class="panel-title">Information</div>
<div class="panel-body">
⚠️ Requires ExLlamaV3 v0.0.23 (or v0.0.22 `dev` branch)
<br/>
exl3 quantizations of <b><a class="link-style" href="https://huggingface.co/Qwen/Qwen3.5-0.8B">Qwen3.5-0.8B</a></b> via
<b><a class="link-style" href="https://github.com/turboderp-org/exllamav3">exllamav3</a></b>.
<br/>
repo generated automatically with
<a class="link-style" href="https://github.com/UnstableLlama/ezexl3">ezexl3</a>.
</div>
</div>
<div class="content-panel">
<div class="panel-title">Repo Data</div>
<div class="panel-body repo-data-body repo-data-panel">
<img class="repo-graph" src="qwen_qwen3.5-0.8b.svg" alt="Quantization graph">
<div class="table-wrapper">
<table class="data-table">
<thead>
<tr>
<th>REVISION</th>
<th>GiB</th>
<th>KL DIV</th>
<th>PPL</th>
</tr>
</thead>
<tbody>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/Qwen3.5-0.8B-exl3-2.10bpw">2.10bpw</a></td>
<td>0.96</td>
<td>0.4642</td>
<td>26.2416</td>
</tr>
<tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/Qwen3.5-0.8B-exl3-3.10bpw">3.10bpw</a></td>
<td>1.02</td>
<td>0.0800</td>
<td>19.0087</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/Qwen3.5-0.8B-exl3-4.00bpw">4.00bpw</a></td>
<td>1.07</td>
<td>0.0238</td>
<td>17.8643</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/Qwen3.5-0.8B-exl3-5.00bpw">5.00bpw</a></td>
<td>1.13</td>
<td>0.0067</td>
<td>17.8094</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/Qwen3.5-0.8B-exl3-6.00bpw">6.00bpw</a></td>
<td>1.19</td>
<td>0.0023</td>
<td>17.6048</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/Qwen3.5-0.8B-exl3-8.00bpw">8.00bpw</a></td>
<td>1.31</td>
<td>0.0009</td>
<td>17.6475</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/Qwen/Qwen3.5-0.8B">bf16</a></td>
<td>1.63</td>
<td>0.0000</td>
<td>17.6029</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
<div class="content-panel">
<div class="panel-title">CLI Download</div>
<div class="panel-body">
<div class="terminal-box">
hf download UnstableLlama/Qwen3.5-0.8B-exl3-6.00bpw --local-dir ./Qwen3.5-0.8B-exl3-6.00bpw
</div>
</div>
</div>
</div>
- Type
- qwen3_5
- License
- apache-2.0
- Created
- Apr 4, 2026
- Updated
- Apr 4, 2026