dream-0.6b-gguf

dream-0.6b — a bedtime storyteller that fits in a browser tab

A 0.6B-parameter model that writes slow, gentle, plotless sleep stories for grown-ups. Built to run fully client-side in the browser (via wllama / WebAssembly) as the story engine behind sleepcast.pro's dream feature — one ~400MB download, then infinite offline stories with nothing leaving the device.

What it does

Give it a scene ("a greenhouse in soft rain", "a night ferry crossing calm water") and it wanders: soft sensory prose, no plot, no urgency, no cliffhangers — words designed to be listened to while falling asleep.

Prompt format

This is a completion model (not chat). Use exactly this frame, including the primed opening line — the model continues from it:

A slow, gentle bedtime story for grown-ups. No plot, no urgency — soft words that wander until the listener drifts off.

Topic: {your scene}

Story:
Let yourself sink down into the quiet. Wherever you are right now, let it hold you. There's nowhere to be and nothing to do. Just breathe, slow and easy, and let these words carry you somewhere soft and far away.

Recommended sampling: temperature 0.8, top_p 0.95. The full intro prime matters — shorter primes let the base model's multilingual pretraining leak through at the seam.

llama.cpp

llama-completion -m dream-0.6b-Q4_K_M.gguf -p "$(cat prompt.txt)" \
  -n 2000 --temp 0.8 --top-p 0.95

LM Studio

Import the GGUF, use completion/playground mode with the frame above.

How it was made

Knowledge distillation from a two-stage local pipeline:

1. A Qwen3-4B-Base + QLoRA adapter (trained on sleep-podcast-style narration) generated 120 raw stories across a 30-place × 8-texture topic grid.
2. Gemma rewrote each one clean — consistent register, fixed intro/outro brackets, no artifacts — yielding 119 records (~7.2k chars each).
3. Qwen3-0.6B-Base was LoRA-fine-tuned (r32, α64, 8 epochs, bf16) on the clean set, merged, and quantized to Q4_K_M with llama.cpp.

The entire pipeline ran on a single 8GB consumer GPU.

Files

v2 (current) — trained on a 300-story, 60-topic variety-first dataset; real topic-following (v1 mode-collapsed toward one generic story). v2 has NO fixed intro: the prompt ends bare at Story: and the first few tokens may stutter — trim short leading lines. Use repeat penalty ~1.1.

4B chat system prompt: "You are a bedtime storyteller for grown-ups. When given a topic, tell a slow, gentle, plotless story in soft wandering words until the listener drifts off. Never break character, never explain, just tell the story."

v1 (legacy)

Limitations

• English only; single register (soporific narration). It will not answer questions, follow instructions, or hold a conversation — by design.
• No chat template training; chat-mode use produces off-register output.
• Small model: occasional soft non-sequiturs. In its intended use (drowsy listening) these read as features.
• Not for factual, medical, or advisory content of any kind.

Lineage & license

Base model Qwen/Qwen3-0.6B-Base (Apache 2.0). Fine-tune and distillation data produced by the sleepcast pipeline.