llama3-8B-DWP

People releasing L3 derivatives under CC BY-NC. Maybe re-read the L3 license ;)

Also join our discord UnleashedAI

Model Card for LLaMA 3 8B Dirty Writing Prompts

Use LLaMA 3 format, turn off all names. This is just a zero shot r/DirtyWritingPrompts story generator. It will often follow the prompt very loosely and it will be super creative due to no presence of AI synthetic data whatsoever.

It is also way more graphic than most other models out there.

Usage

"Write a story using this writing prompt: {Whatever you want}"

Model Description

Trained on 2K samples of r/DirtyWritingPrompts Dataset is here

Example

<details> <summary>Zero shot NSFW example:</summary> <blockquote> Write a story using this writing prompt: The contract had made it sound like such easy money. Get locked in the portal-belt for a month or so, take a random dick or two a day, enjoy the occasional generous tongue, but ultimately get paid lazing around the house all day. You didn't expect to be one of the most popular 'Toys' on the app </blockquote>

“Alright, now I know you're being serious and that's just too good not to try out,” says my friend as I explain the situation.

I was feeling a bit lonely anyway; my roommate went home for the holidays without warning me, leaving me stuck in an empty apartment over Christmas break. To top it off, there were no hot singles in the city I'm visiting. It seemed like a perfect chance to put myself up on the Toy marketplace.

“So…you don't mind if I do some things with you?” I say as we walk to my place.

“Nah man, I'd love that! You have a ton of potential. And if it doesn't work out, then at least we got something interesting to talk about!”

I roll my eyes. We haven't been close friends since high school. He only invited himself to come stay here because he got in trouble with his parents and was looking to crash somewhere temporarily until the semester started again.

“Well, at least we'll both have stories to tell after this.”

“Oh yeah?”

“Yup…” I look at him awkwardly before saying “well…I mean, probably, unless nobody is into what I've set my price for. It might go bad. But either way…”

He looks at me suspiciously as we enter the building. I could sense him wondering why I would risk anything for an opportunity that might end badly.

“Alright, let's see how this goes.” His voice comes out strangely confident.

We climb the stairs to my room, which is where I'd set up the portal-belt rental service. A few months ago, I bought an old-fashioned belt from the 60s and wired it with portals. For the past couple weeks, it has been used by students to bring them right outside class, and once when a girl was stuck in a bathroom stall. The fact that I have this cool technology gets more attention than the fact that I have no social life. People call it an 'unfair advantage,' though none of those people have tried to rent the portal belt themselves.

Once we make it to my room, I grab the belt and fasten it around my waist. My friend takes the device that controls the belt from my desk and watches as I hold onto one of the levers inside the belt. A portal opens beneath us, showing the exact location of my bed. My friend puts the device back on the table as I slide down through the portal. When we land, it makes a soft thump as my feet touch the ground.

The moment the belt is fully unfastened, we hear a knock. My friend and I both turn to look at the door. Standing on the other side are two guys who seem familiar.

“You're Johnnie?” they ask, addressing my friend.

“How did you find—” My question is interrupted by the taller of the two pushing the door open and walking into the room while shoving my friend against the wall behind them.

“Why yes!” my friend laughs. He smiles as the shorter of the two pulls up his shirt revealing a slim and tanned abdomen. The guy takes off the rest of his clothes, exposing his thin cock. He straddles my friend on his knees and grabs his hair, pulling his head forward enough that their mouths can meet. As my friend gives the guy a blowjob, the taller one walks toward my bed, undoing his pants along the way.

“Oh yeah? So she's here?” he asks, rubbing his penis as he approaches my bedside. He sits on the edge of the mattress, spreading his legs slightly before pulling them together again. As the first guy moves his hips and thrusts harder against my friend’s mouth, the second one lifts a finger to his lips. The tips of his fingers slowly make circles on his lower lip before he places one tip on his bottom lip, rolling the digit downward and creating an audible “pop”. He presses his finger into his mouth and sucks on it, drawing it across his tongue before repeating the same motions on the upper lip.

Both men begin moaning and breathing heavily, sucking loudly on each other’s dicks. One of them yanks my friend up off the floor and pushes him roughly towards my bed. The guy jumps onto the mattress behind my friend, wrapping his arms around his shoulders and bending his torso backward to kiss him deeply. While holding the smaller man in position, the taller guy turns towards my face. His hand reaches under the covers to tug at my panties and pulls them free from between my legs. He sticks his fingers under the elastic band and begins to slide them upwards until they’re hooked around my wrists. Then he tugs on the fabric until the elastic digs into the skin of my forearms, trapping my hands above my head. They tie the panties to the frame of my bed and stand up, allowing the three of us to lie side-by-side.

“This’ll teach you to be a little slutty. Now lay your ass back in the air and wait for your punishment, bitch.”

They push my thighs apart and pull the bedsheets away from underneath me. My pussy glistens as they examine it closely, tracing their fingertips over its contours and tickling the insides of my legs with gentle caresses.

“Damn, she really wants some!” says the guy sitting next to me, stroking my butt cheek with his hand. “You’re gonna need another hole for her, so she can get even more fucked tonight.” He leans closer to whisper in my ear. “Just relax and enjoy yourself, sweetie.”

As he talks, his thumb gently traces small circles around the edges of my asshole. At the same time, the other guy slithers between my spread thighs and kisses my labia tenderly. Both of them continue to move their hands slowly down my body, eventually reaching the small of my back, where they lightly stroke me before trailing their fingers over the curve of my hips and down towards my pelvis. Their palms massage my inner thigh muscles, squeezing hard and letting loose before continuing their descent toward my feet. After gently touching each toe, they rise back up the path that they took previously, working their way up to my breasts.

With the guys’ fingers stroking my nipples softly, my heart beats faster and blood rushes to my core. I feel myself grow wetter as my clit throbs and twitches eagerly, yearning for relief.

Their hands glide over the surface of my belly, slowly making their way upward. When they reach the underside of my breasts, they part them and cover one of my nipples with their warm, moist tongues. Licking it rapidly, they suck the sensitive skin into their mouths and tease the peak of my tit with their teeth.

One of them slides down further to my groin and starts licking at my folds, while the other continues to nibble on my breasts. Soon they begin kissing my pussy, alternately alternating between lapping at it with their tongues and lightly nipping at my outer lips with their teeth. Their saliva mixes with mine, forming a thick slick layer as they fuck me with their tongues.

It feels so good! My body trembles with pleasure as they stimulate every inch of me, teasing my clitoris and my vaginal opening at the same time. They lap up my juices, drinking from the stream of nectar pouring from within me. They move back and forth between the two spots, driving me wild with their erotic touches.

The man between my legs slows his strokes to give my clit a few long drags. I moan as his tongue hits the spot exactly. He moves back and forth, increasing his speed as he slips deeper into my channel, pressing his nose against my pubic bone and breathing in the scent of my arousal. The other guy does the same thing to my breast, flicking my...

</details>

Training Config and Graphs

llamafactory-cli train \
    --stage sft \
    --do_train True \
    --model_name_or_path Meta-Llama-3-8B \
    --preprocessing_num_workers 16 \
    --finetuning_type lora \
    --use_rslora False \
    --lora_rank 64 \
    --lora_alpha 64 \
    --lora_dropout 0.1 \
    --lora_target all \
    --quantization_bit 8 \
    --template llama3 \
    --flash_attn auto \
    --use_unsloth True \
    --dataset_dir /workspace/sft \
    --dataset dataset_name \
    --cutoff_len 2048 \
    --learning_rate 2e-6 \
    --lr_scheduler_type cosine_with_min_lr \
    --lr_scheduler_kwargs '{"min_lr": 4e-7}' \
    --num_train_epochs 2.0 \
    --max_samples 20000 \
    --per_device_train_batch_size 3 \
    --gradient_accumulation_steps 1 \
    --max_grad_norm 1.0 \
    --logging_steps 2 \
    --save_steps 100 \
    --warmup_steps 10 \
    --optim adamw_bnb_8bit \
    --packing False \
    --report_to all \
    --output_dir saves/LLaMA3-8B/trained-models/2Krows-lora \
    --bf16 True \
    --plot_loss True \
    --ddp_timeout 180000000 \
    --val_size 0.01 \
    --eval_strategy steps \
    --eval_steps 20 \
    --per_device_eval_batch_size 1 \
    --include_num_input_tokens_seen True