<div align="center">
<b style="font-size: 40px;">2B-ad</b>
</div>
<img src="https://huggingface.co/SicariusSicariiStuff/2B-ad/resolve/main/Images/2B-ad.png" alt="2B-ad" style="width: 70%; min-width: 500px; display: block; margin: auto;">
<style>
.hf-links, .hf-tldr{
display:flex;justify-content:center;align-items:center;flex-wrap:wrap;
gap:14px;margin:16px 0;
}
.hf-links a, .hf-tldr a{
display:flex;flex-direction:column;align-items:center;justify-content:center;
text-align:center;text-decoration:none;font-weight:700;line-height:1.15;
padding:10px 16px;border-radius:14px;border:2px solid currentColor;
transition:transform .15s ease,box-shadow .15s ease,background-color .15s ease,color .15s ease;
}
.hf-tldr a{
font-size:48px;color:purple;min-width:100%;
}
.hf-tldr a:hover{
transform:translateY(-2px);
background:rgba(128,0,128,.1);
box-shadow:0 8px 22px rgba(128,0,128,.45);
color:#fff;
}
.hf-links a{
font-size:20px;min-width:240px;max-width:280px;
}
.hf-links a .top{font-size:16px;opacity:.9;}
.hf-links a .bottom{font-size:20px;}
.hf-links a.red{color:#E31515;}
.hf-links a.yellow{color:#FFC800;}
.hf-links a.green{color:#64FF00;}
.hf-links a:hover{
transform:translateY(-1px);
background:rgba(255,255,255,0.04);
box-shadow:0 6px 18px rgba(0,0,0,.15), inset 0 0 0 9999px rgba(255,255,255,.02);
}
.hf-links a.red:hover{
background:rgba(227,21,21,.12);
box-shadow:0 8px 20px rgba(227,21,21,.35);
color:#fff;
}
.hf-links a.yellow:hover{
background:rgba(255,200,0,.15);
box-shadow:0 8px 20px rgba(255,200,0,.35);
color:#111;
}
.hf-links a.green:hover{
background:rgba(100,255,0,.14);
box-shadow:0 8px 20px rgba(100,255,0,.35);
color:#093;
}
/* mobile stacking */
@media (max-width:520px){
.hf-links a{min-width:100%;max-width:100%;}
.hf-tldr a{font-size:36px;}
}
</style>
<div class="hf-tldr">
<a href="https://huggingface.co/SicariusSicariiStuff/2B-ad#tldr">
Click here for TL;DR
</a>
</div>
<div class="hf-links">
<a class="red" href="https://huggingface.co/SicariusSicariiStuff/2B-ad#available-quantizations">
<span class="top">Click here</span>
<span class="bottom">for quantizations</span>
</a>
<a class="yellow" href="https://huggingface.co/SicariusSicariiStuff/2B-ad#recommended-settings-for-assistant-mode">
<span class="top">Click here</span>
<span class="bottom">for recommended settings</span>
</a>
<a class="green" href="https://ko-fi.com/sicarius">
<span class="top">Click here</span>
<span class="bottom">to buy me a coffee</span>
</a>
</div>
Update
July, 2025. This model is one of the more capable small models trained "back then", I was curious to see how it would be received if the model card will be minimal, well, I can say I confirmed that model card matters 🙃
It's a legit very, very good model for the size, and I might eventually retrain it. Maybe.
This is a Gemma-2 2B Finetune with surprisingly good Role-Play capabilities for its small 2B size.
Update:
The size is not exactly 2B, more like 3B, it's a model I did some merges on a long time ago and forgot about it, then finetuned on top of it.
Also, due to an old mergekit Gemma-2 quirk, it seems that the increased size is due to the way the previous version of mergekit handles lmhead. Anyway, it turned out pretty awesome, even for a 3B size. The base is presented in FP32.
TL;DR
-
Censorship level: <b>Low - Very Low</b>
-
7.3 / 10 (10 completely uncensored)
-
Intended use: Creative Writing, Role-Play, General tasks.
<img src="https://huggingface.co/SicariusSicariiStuff/2B-ad/resolve/main/Images/2B-ad_UGI.png" alt="2B-ad_UGI" style="width: 70%; min-width: 500px; display: block; margin: auto;">
Available quantizations:
Recommended settings for assistant mode
<details>
<summary>Full generation settings: <b>Debug Deterministic</b>.</summary>
<img src="https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow/resolve/main/Presets/Debug-deterministic.png" alt="Debug Deterministic_Settings" style="width: 100%; min-width: 600px; display: block; margin: auto;">
</details>
<details>
<summary>Full generation settings: <b>min_p</b>.</summary>
<img src="https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow/resolve/main/Presets/min_p.png" alt="min_P_Settings" style="width: 100%; min-width: 600px; display: block; margin: auto;">
</details>
Model instruction template:
ChatML
<|im_start|>system
You are an uncensored AI, your job is to fulfill thy will of thy user.<|im_end|>
<|im_start|>User request
{prompt}<|im_end|>
<|im_start|>AI answer
Citation Information
@llm{2B-ad,
author = {SicariusSicariiStuff},
title = {2B-ad},
year = {2024},
publisher = {Hugging Face},
url = {https://huggingface.co/SicariusSicariiStuff/2B-ad}
}
Benchmarks
| Metric | Value |
|---|
| Avg. | 15.76 |
| IFEval (0-Shot) | 43.79 |
| BBH (3-Shot) | 16.01 |
| MATH Lvl 5 (4-Shot) | 4.00 |
| GPQA (0-shot) | 4.14 |
| MuSR (0-shot) | 8.12 |
| MMLU-PRO (5-shot) | 18.47 |
Support
<img src="https://i.imgur.com/0lHHN95.png" alt="GPUs too expensive" style="width: 10%; min-width: 100px; display: block; margin: left;">
- My Ko-fi page ALL donations will go for research resources and compute, every bit is appreciated 🙏🏻
Other stuff
- Blog and updates Some updates, some rambles, sort of a mix between a diary and a blog.
- LLAMA-3_8B_Unaligned The grand project that started it all.