Ethereal-Rainbow-v0.1-11B

Ethereal Rainbow v0.1 11B

About

Ethereal Rainbow is an 11B parameter frankenmerge of various Llama3-based finetunes created using mergekit. The purpose of Ethereal Rainbow is to create an uncensored Llama3 variant which is capable of writing creative prose, and engaging in SFW as well as NSFW roleplay and storytelling.

I don't consider v0.1 to be a 'finished product' by any means, but I've been getting some good results out of it so I wanted to share.

Usage

Prompt Format

Use Llama-3 Instruct prompting:

<|begin_of_text|><|start_header_id|>system<|end_header_id|>

{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>

{input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>

{output}<|eot_id|>

Recommended Settings

This is what I've been playing with, this model seems to run pretty hot by default:

Temperature - 0.60-0.80
Min-P - 0.08
Repetition Penalty - 1.05

Sample Output

<details><summary>'Weird Fiction' Sample</summary>

PROMPT

Write me the opening chapter of a 'weird fiction' novel, drawing inspiration from the writing styles of China Mieville and Neil Gaiman. Use third person personal. Include dialogue and internal monologues. The POV character for the opening chapter should be a male in his 20s called Horton who has just come to the city looking for work.

RESPONSE

Horton stepped off the train onto the rusted platform, the humid air of the city enveloping him like a damp shroud. The cacophony of horns, engines, and distant laughter assaulted his ears, a far cry from the peaceful tranquility of his small town upbringing. He had never been to a city this size before, and the sheer scale of it overwhelmed him. Towering skyscrapers loomed above, their glass and steel surfaces reflecting the setting sun in a kaleidoscope of colors. The streets were alive with people of all shapes, sizes, and colors, rushing to and fro with purposeful strides. Horton felt insignificant amidst the throng, a mere speck in the grand tapestry of humanity.

He clutched his worn backpack tightly to his chest, the only possession he had left after selling everything he owned to make the journey. His heart pounded in his throat as he scanned the crowded platform, searching desperately for a familiar face among the sea of strangers. His mother had promised she would be here to greet him, but now, as the minutes ticked by with no sign of her, a creeping sense of dread began to settle in. Had something happened? Was she even coming at all?

As panic started to grip him, a gruff voice cut through the din. "New guy, right?" Horton turned to see a burly man in a dirty construction hat approaching him, a weathered hardhat in one hand and a crumpled employment ad in the other. "Name's Jack. I saw you hop off that train. You look lost."

Horton swallowed hard, trying to steady his nerves. "Uh, yeah... I'm Horton. I was supposed to meet my mom here, but..." He trailed off, gesturing helplessly.

Jack chuckled, the sound raspy and smoker-like. "Don't worry, kid. Your ma's probably running late. She's always late." He gave a knowing wink, then held out the employment ad. "Anyway, I got a job lined up for you if you're interested. Night shift at a construction site downtown. Pays decent. You got any experience?"

Horton shook his head, feeling a wave of relief wash over him. Finally, a glimmer of hope in this chaotic metropolis. "Not much, but I'm willing to learn."

"Good enough," Jack said with a nod. "We'll get the details sorted later. Follow me, and I'll show you the site." He turned on his heel and started walking towards the exit, expecting Horton to follow suit. The young man hesitated briefly before giving chase, his backpack bouncing awkwardly between his shoulders.

As they walked, Jack regaled Horton with stories of life in the city, painting a vivid picture of gritty urban realities. Horton listened intently, trying to absorb as much information as possible. The streets they traversed were a labyrinth of rundown tenements, seedy bars, and bustling markets, each corner revealing a new sight, smell, or sound. The city pulsed with an energy he had never experienced before, both exhilarating and terrifying in equal measure.

After what felt like miles of walking, they finally reached the construction site. Floodlights illuminated a vast, open pit, the edges ringed with scaffolding and piles of rubble. Jack led Horton down a narrow staircase into the depths of the excavation, the air growing colder and danker with each step. They emerged into a dimly lit cavernous space, the ceiling lost in darkness. The stench of earth, sweat, and diesel fuel hung heavy in the air.

"This is where we're working," Jack said, gesturing around. "It's gonna be a big project. Luxury condos and some fancy new offices. Rich folks' playground." He snorted derisively. "Gonna gentrify the whole area, kick out the old timers like us."

Horton nodded, taking in the scene. A team of workers were already busy, their flashlights casting eerie shadows across the walls. The sounds of jackhammers, drills, and muffled conversation filled the air. Despite the grueling conditions, there seemed to be a sense of camaraderie among the crew, a brotherhood forged in the trenches of hard labor.

Jack clapped Horton on the shoulder. "You'll fit right in here, kid. We don't mess around with fancy book learning or office jobs. This is real work. Get your hands dirty, and you'll eat well. That's the city way."

Horton glanced around, taking stock of his new surroundings. The thought of diving headfirst into such physically demanding work intimidated him, but desperation had a way of erasing fear. He squared his shoulders, determination settling in. He had come to the city for opportunity, and he wasn't about to let it slip through his fingers. "Yeah, I can handle it," he said, meeting Jack's gaze. "Let's get started."

</details>