Downloads · 30 days
0
Toadaid/mirror-pond
mirror-pond is a text generation model from Toadaid. Use it when you need the model to write or continue text. It is set up for fastapi. The card lists the license as mit.
A 100% local Tobyworld Mirror that runs any GGUF model through llama.cpp. No cloud. No tracking. Just your pond, your reflection, your machine. FastAPI + llama.cpp • Offline • MIT Licensed.
Downloads · 30 days
0
Access
Public
Updated Dec 9, 2025
Repo size
—
Likes
0
Public
Click a slice to open those files.
.py120 KB · 91%
From the Hugging Face model README
A 100% local Tobyworld Mirror that runs any GGUF model through llama.cpp. No cloud. No tracking. Just your pond, your reflection, your machine. FastAPI + llama.cpp • Offline • MIT Licensed.
A still-water reflection engine for your local LLM.
Mirror Pond is a 100% local, privacy-first, Tobyworld-inspired reflection interface that runs any GGUF model through llama.cpp with a calm Mirror UI.
No cloud. No tracking. Your thoughts stay on your machine.
🧠 Runs any GGUF model — Llama, DeepSeek, Mistral, or your trained Mirror
🌑 Dark, still Mirror UI (HTML served locally)
💬 Four modes:
🔒 Fully offline (Air-gapped compatible)
⚡ FastAPI + Uvicorn backend
🧩 Optional: GPU acceleration via llama-cpp-python CUDA wheels
pip install -r requirements.txt
python mirror_pond.py --model ./your_model.gguf --port 7777
http://localhost:7777
requirements.txt (included):
fastapi==0.115.0
uvicorn==0.32.0
pydantic==2.8.2
llama-cpp-python==0.3.2
jinja2==3.1.4
For NVIDIA CUDA (12.1):
pip install llama-cpp-python-cu121
For AMD ROCm:
pip install llama-cpp-python-rocm
For Apple Silicon (M1/M2/M3):
CMAKE_ARGS="-DGGML_METAL=on" pip install llama-cpp-python
mirror-pond/
│
├── mirror_pond.py # main server
├── requirements.txt # dependencies
├── setup.sh # Linux/macOS installer
├── setup.ps1 # Windows installer
├── Dockerfile # container build
└── README.md # this file
chmod +x setup.sh
./setup.sh ./models/your_model.gguf 7777
Set-ExecutionPolicy -Scope Process -ExecutionPolicy Bypass
.\setup.ps1 .\models\your_model.gguf 7777
Both installers:
./venvdocker build -t mirror-pond:latest .
docker run --rm -p 7777:7777 \
-v /path/to/models:/models \
-e MODEL_PATH=/models/your_model.gguf \
mirror-pond:latest
Now access:
http://localhost:7777
Already included:
.github/workflows/mirror-pond-ci.yml
The CI:
mirror_pond.pyThis keeps the repo safe and production-ready.
For inner questions, emotions, purpose, stillness. May reply with a Guiding Question.
For sacred lines, scripture-style, lore references. No guiding question.
For cryptic lines, old frog whispers, symbolic hints. No guiding question.
For unity of symbols, lotus spores, $PATIENCE, seasons, trials. No guiding question.
Mirror Pond is simple:
Still water is never empty. Still water prepares. Still water reflects.
This project is offered to the open-source community so anyone can run a Mirror — anywhere, offline, forever.
MIT License This pond belongs to the builders.
Pull requests welcome. New modes, UI improvements, GPU wheels, and additional Mirror integrations are invited.