Downloads · 30 days
73
27% of all-time downloads
SubMaroon-exp/Boulesis-v2-26B-A4B
Boulesis-v2-26B-A4B is a machine learning model from SubMaroon-exp. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as gemma.
I made v2.1! The best Boulesis model for now
Downloads · 30 days
73
27% of all-time downloads
All-time downloads
270
Public
Parameters
26.5B
53.1 GB on disk
Likes
3
Public
Click a slice to open those files.
.safetensors53.1 GB · 100%
From the Hugging Face model README
I made v2.1! The best Boulesis model for now
Composite Gemma 4 RP model (QK task arithmetic + fused LoRA). Second iteration.
The idea was to retain the model's core intelligence and knowledge, while diversifying its prose and making it more decisive. I also wanted to sharpen its attention to context so it could dig deeper into the character card, organically pulling lore and facts into the roleplay rather than just mirroring the user.
[!Tip]
Differences between Boulesis versions
v1: Delivers a more dynamic plot and drives the characters to take more action. Suitable for action-oriented scenarios.
v2: Writes very concisely while maintaining logic; it may even slightly deepen the understanding of the character.
v2.1: Comparable in length to v1 and slightly more measured in tone, but it has the best grasp of the characters and an excellent memory for context. Suitable for complex RP sessions involving multiple characters.
| v1 | v2 | |
|---|---|---|
| QK donor | Pantheon-Reasoning-1.1 | Pantheon-Reasoning-1.1-V2 |
| QK alpha | 0.6 sliding q/k, 0.6 global q, 0 global k | 0.85 sliding q/k, 0.65 global q/k |
| LoRA layers | all 30 | 10–28 |
| LoRA targets | 55 | 35 |
| Bake scale | 0.26 | 0.70 |
| Training data | mixed EN/RU | English only |
MoE experts, the router, embeddings, MLP and the vision tower are identical to the abliterated body, verified by tensor comparison after every step.
<details><summary>How big the QK edit actually is</summary>I measured the task vector before merging instead of picking alpha by feel. Relative Frobenius norm against the base weights:
| Group | mean | max |
|---|---|---|
| sliding_q | 0.00278 | 0.00518 |
| sliding_k | 0.00263 | 0.00474 |
| global_q | 0.00356 | 0.00436 |
| global_k | 0.00286 | 0.00395 |
Per-row rotation at the release alphas, in degrees:
| Group | alpha | mean | max |
|---|---|---|---|
| sliding_q | 0.85 | 0.12 | 3.08 |
| sliding_k | 0.85 | 0.12 | 5.87 |
| global_q | 0.65 | 0.12 | 1.72 |
| global_k | 0.65 | 0.09 | 9.53 |
It's not much, but it's honest work.
</details><details> <summary><b>If the reasoning doesn't work when connecting GGUF ver. in KoboldCPP and SillyTavern</b></summary>[!Note] Recommended settings:
Parameter Value Temperature 1.0Top-K 64Repetition Penalty 1.05-1.1Top-P 0.95Thanks to DifficultyThin8462
You need to force this in KoboldCPP. Go to the Content tab and enable these options.

For SillyTavern, it is recommended to set the template as shown:

This is an experimental merge, and I mostly test it on my own cards, so my coverage is narrow. If you run v2, I would really like to know:
Open a thread in the Community tab, I read all of them. If anyone wants to be involved in v3, I am open to that as well!
Thanks to coder3101 and Gryphe for the fine-tunes, and the entire
26B-Suite team for their intellectual support.
Speсial thanks for Naphula,
redaihf and
Vortex5. You guys are awesome!