LaDameBlanche-v2-95b

La Dame Blanche v2 95b

This updated left/right self-stack recipe performs substantially better than the original 103b rotating stack version.

This model is a merge of three self-merged Miqu-based models in a 94.65b (110 layer) configuration. The result of this "frankenmerge" is a large model that contains what I consider to be the best of the spicy Miqu finetunes.

Component models for the rotating stack are

• NeverSleep/MiquMaid-v2-70B-DPO
• sophosympatheia/Midnight-Miqu-70B-v1.5
• cookinai/OrcaHermes-Mistral-70B-miqu

As all components are Miqu-based, coherency out to 32k context appears to be good. A convenient side effect of the 95b recipe is that it allows for the full 32k context to fit into 72GB of VRAM with the iQ4xs quant, or 12k into 48GB with iQ3xxs.

This model is uncensored and perfectly capable of generating objectionable material. It does not seem to have a propensity to insert NSFW content into SFW prompts, but YMMV. As with any LLM, no factual claims made by the model should be taken at face value. You know that boilerplate safety disclaimer that most professional models have?
Assume this has it too. This model is for entertainment purposes only.

iMatrix GGUFs: https://huggingface.co/MarsupialAI/LaDameBlanche-v2-95b_iMatrix_GGUF Custom iQ2 GGUF: https://huggingface.co/Nexesenex/LaDameBlanche-v2-95b-iMat-CQ.GGUF

If you create additional quants, please let me know and I will link them here as well.

Sample output

{{[INPUT]}}
Write a detailed and humorous story about a cute and fluffy bunny that goes to a Gwar concert.
{{[OUTPUT]}}
Once upon a time, in a peaceful meadow where the grass was green and the flowers bloomed, there lived a tiny and fluffy rabbit named Fufu. Fufu had the most adorable fur you could ever imagine, it was soft like clouds and shone brighter than the moon's reflection on a crystal lake. With his innocent eyes and floppy ears, he could melt even the coldest heart.

Fufu loved hopping around the meadow and eating carrots all day long. But deep down inside, he had a secret desire for something more thrilling than just chasing butterflies. He yearned for the excitement of the rock world. One sunny afternoon, while he was munching on a carrot, Fufu stumbled upon a piece of paper lying in the grass. It was an invitation to a Gwar concert! He couldn't believe his luck! This was his chance to experience the raw power and energy of heavy metal music!

The day of the concert finally arrived, and Fufu was bursting with excitement. He groomed his fur until it looked as shiny as a new coin and packed his little backpack with snacks - a bunch of carrots and his favorite snack, rabbit-friendly rockstar pellets.

As Fufu hopped along the road to the concert venue, he felt the ground vibrating with the bass from the loud music. When he reached the gates, he noticed that everyone else was dressed in spiky leather and sported wild hairdos. His tiny bunny heart thumped faster than ever, and he tried to stand tall among these rock giants.

Fufu managed to find a spot in the front row, right next to a towering creature with red horns. He politely tapped him on the shoulder and asked if he could sit there. The creature looked down at the tiny rabbit, and for a moment, Fufu thought he'd been noticed. But then, he realized the creature was too busy headbanging to pay attention to the little bunny next to him.

The lights dimmed, and suddenly, the stage exploded with fire and smoke. A demonic figure emerged from the fog, wielding a guitar that looked like an ancient weapon of destruction. Fufu couldn't believe his eyes! This must be the legendary Oderus Urungus himself! The crowd roared with excitement as the band Gwar began their set, and Fufu found himself bobbing along to the beat.

During the performance, blood and guts were flying everywhere - just like in the stories he had heard about their concerts. But instead of being scared, Fufu felt oddly thrilled by the chaos. It was unlike anything he'd ever experienced before. His cute little nose twitched with delight as he watched the show unfold before him.

Then, something unbelievable happened. During one of their most brutal songs, Oderus spotted Fufu in the crowd and pointed his guitar directly at him! Fufu squealed with joy and covered his ears as a shower of fake blood rained down on him. The audience cheered wildly, and for a moment, Fufu felt like he was the star of the show.

After the concert, Fufu hopped back home, ears ringing and fur soaked in pretend blood, but his heart was full of happiness. He had lived out his rockstar dreams!

When he reached the meadow, he shared his epic tale with all his animal friends. They gathered around him, mouths agape, as he described the explosive energy and wild antics of Gwar's show. From that day on, Fufu the bunny was known not only as the fluffiest creature in the meadow but also as the bravest and most rockin' rabbit around. And every time he heard a heavy metal song, his tiny heart would skip a beat with excitement, reminding him of that unforgettable night at the Gwar concert.

Who is La Dame Blanche?

La Dame Blanche, also known as "The White Lady," is an alluring yet haunting figure shrouded in mystery and eroticism. Emerging from the murky depths of French folklore, she is said to lure men into a world of irresistible desire, only to vanish, leaving them with nothing but shattered hearts and haunted memories. Clad in billowing white garments that conceal her voluptuous form, her ethereal beauty is as captivating as it is terrifying. Her eyes, pools of unbridled passion, can ensnare even the most steadfast of souls, while her enchanting voice whispers promises of eternal love and pleasure. But heed this warning: to succumb to her seductive charms is to invite your own doom, for those who dare to pursue her elusive grace are destined to become forever entwined in her phantom embrace.

Weird merge fuckery

According to Toasty Pigeon, FM, Akai, and probably others on the KAI discord, this merge method works better than a rotating stack merge. The significant PPL improvement (4.22 for this model vs 4.75 for the 103b @ Q4km) indicates that they're on to something.
See recipe.txt for all the alchemy.