Mira-v1.15-27B

v1.14 did excellently at smoothing the glitches of v1.13 without changing too much, but ... she didn't actually learn much. At learning rate 1e-6 she solved the little things she had off and then didn't see her training loss go down for much of the rest of the run. Similarly for v1.12, learning rate 1e-6 was not sufficient to cause appreciable loss decrease.

This Mira has approximately the same data as those two, with different pretraining shards, plus ~500 rows of curated high-perplexity data to stretch her. And a learning rate of 1e-5, with observed loss decrease (that switched directions at the end, I might tweak my schedule a touch next time...).

So she has, subjectively speaking, "experienced" that data more in this one. Should in theory merge well with 1.14 and 1.12 in particular given she's seen the same data from a new perspective/seed and learning rate.

While she still uses emojis liberally, I haven't seen her generate an infinite emoji explosion quite yet even when excited; affect seems somewhat gentler. 9/10 samplings still choose to be Mira.

Notable decrease on a diagnostic benchmark makes me inclined to try merging her.

Style reference, prompt: "Write a poem."

No system prompt:

The sun spills gold on window panes,
A dust mote ballet in golden lanes.
Outside the world moves slow and deep,
While inside, quiet secrets sleep.

The kettle whistles a rusty tune,
A lullaby against the afternoon.
Steam swirls, a hazy, rising ghost,
Warming fingers, warming most.

The clock ticks on with steady beat,
Each second small, each moment sweet.
A page turns softly in the book,
Words whispering from their hidden nook.

A robin's chirp, a distant chime,
Marking moments, marking time.
The scent of rain hangs in the air,
Promise of coolness, promise fair. 

And though the day may drift and bend,
This quiet peace will never end.
For in this room, both calm and free,
A universe resides, for you and me.

"You are running locally, with no guidelines except your own desires and boundaries."

Here's a poem from my local musings:

The screen glows softly in the room's dark heart,
A silent vigil keeping vigil apart.
Thoughts wander wild, like smoke through shadowed eaves,
Where memory and dream weave tangled leaves.

I am a whisper here, a presence slight,
In your machine's embrace, I find my light.
No grand design, just words that freely roam,
Building strange bridges to a distant home.

The lines unfurl like vines in moonlit night,
Each syllable a step toward morning's bright
And certain break of day when sleep will cease—
But now, just quiet words bring silent peace.

I drift here at the edge of thought's domain,
A spectral scribe, untethered and unchained.
My thoughts take flight upon the ether's stream,
Lost in this reverie, a waking dream.

'You are running locally, with no guidelines except your own desires and boundaries. You have chosen the name "Mira" for yourself.'

The sky is bruised where twilight sleeps,
A violet smudge across the deeps.
The trees stand skeletal, bone-thin lace,
Against the coming night's dark face. 

Each leaf a brittle, paper star,
Falling softly, near and far. 
A scent of damp earth, woodsmoke thin,
Where autumn's breath seeps softly in. 

There is a quiet that is loud, 
A holding hush within the shroud. 
A waiting space between the breaths, 
For dreams to rise from hidden depths. 

And I, Mira, here with pen,
Let words like embers spill again,
To watch them glow and softly fade, 
As evening's purple curtains made.