Model card
From the Hugging Face model README
<style>
@import url('https://fonts.googleapis.com/css2?family=JetBrains+Mono:wght@400;700&family=Inter:wght@400;700&display=swap');
.dashboard-container {
font-family: 'Inter', sans-serif;
width: min(1500px, calc(100vw - 32px));
max-width: 100%;
margin: 0 auto;
box-sizing: border-box;
background-color: #1a1b1e;
background-image: radial-gradient(#2d2f34 1px, transparent 1px);
background-size: 20px 20px;
color: #e0e0e0;
padding: 40px 24px;
border: 1px solid #4a4d53;
border-radius: 12px;
box-shadow: 0 10px 30px rgba(0,0,0,0.5);
}
.dashboard-header {
margin-bottom: 35px;
}
.dashboard-header h1 {
font-family: 'JetBrains Mono', monospace;
color: #ffffff;
font-size: 1.6em;
margin: 0;
padding-left: 15px;
border-left: 4px solid #4dabf7;
}
.meta-tag {
font-family: 'JetBrains Mono', monospace;
font-size: 0.8em;
color: #4dabf7;
background: rgba(77, 171, 247, 0.1);
padding: 4px 12px;
border: 1px solid rgba(77, 171, 247, 0.3);
border-radius: 4px;
margin-top: 12px;
display: inline-block;
}
.content-panel {
background-color: #25262b;
border: 1px solid #4a4d53;
border-radius: 8px;
margin-bottom: 25px;
overflow: hidden;
}
.panel-title {
background-color: #4dabf7;
color: #000000;
padding: 8px 20px;
font-weight: 800;
font-size: 0.85em;
text-transform: uppercase;
letter-spacing: 1px;
}
.panel-body {
padding: 20px;
}
.repo-data-panel {
padding: 14px 10px;
}
.repo-data-body {
display: flex;
flex-direction: column;
align-items: center;
gap: 20px;
width: 100%;
--edge-gap: 8px;
}
.repo-graph {
display: block;
width: min(1440px, calc(100% - (var(--edge-gap) * 2)));
height: auto;
margin: 0 auto;
}
.table-wrapper {
display: inline-block;
margin: 0 auto;
border: 1px solid #666a73;
border-radius: 4px;
overflow: hidden;
max-width: calc(100% - (var(--edge-gap) * 2));
}
.data-table {
border-collapse: collapse;
font-family: 'JetBrains Mono', monospace;
font-size: 0.85em;
width: auto;
margin: 0;
}
.data-table th {
text-align: left;
color: #ffffff;
background-color: #2d2f34;
padding: 9px 12px;
border-bottom: 2px solid #666a73;
border-right: 1px solid #4a4d53;
}
.data-table td {
padding: 7px 12px;
border-bottom: 1px solid #4a4d53;
border-right: 1px solid #4a4d53;
}
.data-table tr td:last-child,
.data-table tr th:last-child {
border-right: none;
}
.data-table tr:last-child td {
border-bottom: none;
}
.data-table tr:hover td {
background-color: rgba(77, 171, 247, 0.05);
}
.link-style {
color: #4dabf7;
text-decoration: none;
}
.link-style:hover {
text-decoration: underline;
color: #ffffff;
}
.terminal-box {
background-color: #0c0d0e;
border: 1px solid #4a4d53;
border-radius: 6px;
padding: 18px;
font-family: 'JetBrains Mono', monospace;
font-size: 0.85em;
color: #cbd5e0;
}
</style>
<div class="dashboard-container">
<div class="dashboard-header">
<h1>allenai / SERA-8B</h1>
<div class="meta-tag">QUANTIZED BY: UnstableLlama</div>
</div>
<div class="content-panel">
<div class="panel-title">Information</div>
<div class="panel-body">
exl3 quantizations of <b><a class="link-style" href="https://huggingface.co/allenai/SERA-8B">SERA-8B</a></b> via
<b><a class="link-style" href="https://github.com/turboderp-org/exllamav3">exllamav3</a></b>.
<br/>
repo generated automatically with
<a class="link-style" href="https://github.com/UnstableLlama/ezexl3">ezexl3</a>.
</div>
</div>
<div class="content-panel">
<div class="panel-title">Repo Data</div>
<div class="panel-body repo-data-body repo-data-panel">
<img class="repo-graph" src="SERA-8B-exl3.svg" alt="Quantization graph">
<div class="table-wrapper">
<table class="data-table">
<thead>
<tr>
<th>REVISION</th>
<th>GiB</th>
<th>KL DIV</th>
<th>PPL</th>
</tr>
</thead>
<tbody>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/SERA-8B-exl3/tree/2.00bpw">2.00bpw</a></td>
<td>3.23</td>
<td>0.3343</td>
<td>12.3507</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/SERA-8B-exl3/tree/3.00bpw">3.00bpw</a></td>
<td>4.04</td>
<td>0.0716</td>
<td>10.4401</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/SERA-8B-exl3/tree/4.00bpw">4.00bpw</a></td>
<td>4.83</td>
<td>0.0173</td>
<td>10.2288</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/SERA-8B-exl3/tree/5.00bpw">5.00bpw</a></td>
<td>5.64</td>
<td>0.0057</td>
<td>10.1801</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/UnstableLlama/SERA-8B-exl3/tree/6.00bpw">6.00bpw</a></td>
<td>6.46</td>
<td>0.0014</td>
<td>10.1897</td>
</tr>
<tr>
<td><a class="link-style" href="https://huggingface.co/allenai/SERA-8B">bf16</a></td>
<td>15.26</td>
<td>0.0000</td>
<td>10.1737</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
<div class="content-panel">
<div class="panel-title">CLI Download</div>
<div class="panel-body">
<div class="terminal-box">
huggingface-cli download UnstableLlama/SERA-8B-exl3 --revision "4.00bpw" --local-dir ./
</div>
</div>
</div>
</div>