Behemoth-123B-v2.2-8.0bpw-h8-exl2

I have no idea what I’m doing… if this causes the apocalypse someone please let me know.

Behemoth-123B-v2.2 8.0bpw h8 EXL2

Includes measurement.json file for further quantization

“I’ll be taking a break until mid-2025 to recoup some funds, might still do small models occasionally, but anything big will have to wait. See you all next year! 😊”

FuturisticVibes lied as naturally as they breathed. Merry Christmas, Happy New Year!

Original Model: https://huggingface.co/TheDrummer/Behemoth-123B-v2.2

Original Model Card

Join our Discord! https://discord.gg/Nbv9pQ88Xb

Nearly 2500 members strong 💪

Now with more channels! A hub for creatives and makers alike!

---

BeaverAI proudly presents...

The finetune that made people buy another 3090...

Behemoth 123B v2.2 🦣 - Chaos Edition

Nothing in the void is foreign to us. The place we go is the place we belong.

Links

• Original: https://huggingface.co/TheDrummer/Behemoth-123B-v2.2
• GGUF: https://huggingface.co/TheDrummer/Behemoth-123B-v2.2-GGUF
• iMatrix: https://huggingface.co/bartowski/Behemoth-123B-v2.2-GGUF (recommended for smaller quants)

Description

Behemoth v2.x is a finetune of the new Largestral 2411 with system prompt support. Testers have noted that everything felt improved.

Usage

Testers say this frankenformat maximizes the model's potential: Metharme with Mistral's new system tokens

• [SYSTEM_PROMPT] <|system|>{{system_message}}[/SYSTEM_PROMPT]<|user|>{{user_message}}<|model|>{{assistant_message}}
• <|system|>[SYSTEM_PROMPT] {{system_message}}[/SYSTEM_PROMPT]<|user|>{{user_message}}<|model|>{{assistant_message}}

Take note that the opening system tag SHOULD ALWAYS have a leading whitespace after it.

Complete SillyTavern Settings in BeaverAI Club: https://discord.com/channels/1238219753324281886/1309968730301792370/1309968730301792370

Mirror: https://rentry.org/cd32disa

Versions

• v2.0 is equivalent to Behemoth v1.0 (Classic)
  • Claude-like creativity and prose
  • Very familiar style
  • Solid for all tasks
• v2.1 is equivalent to Behemoth v1.1 (Creative Boost)
  • Creative and lively
  • Unique prose
  • Balanced enough for RP and other tasks
• v2.2 is a cranked up version of Behemoth v2.1 (Unhinged)
  • Creatively unhinged
  • Constantly unique prose
  • May be too chaotic for strict RP, thrives in adventure / story

Special Thanks

Thank you to each and everyone who donated/subscribed in Ko-Fi 🙇 I hope to never disappoint!

Toasty Pigeon
theguywhogamesalot
Grozi
F
Marinara
Ko-fi Supporter
Grozi
Phaelon
ONTHEREDTEAM 
EvarinSharath'fe(USM-Valor)
Silva
Dakkidaze
AlexTheVP
Pseudo
Kistara
Dr. Fjut
Grozi 🥈
KinjiHakari777
dustywintr
Syd
HumbleConsumer
Syd
Ko-fi Supporter
Arkamist
joe 🥇
Toad
Lied
Konnect
Kistara
Grozi 🥉
SleepDeprived3
Luigi
Nestor

https://ko-fi.com/thedrummer/leaderboard

Finetuned by yours truly,
Drummer

Thank you Gargy for the GPUs!