Quick facts
- Best for
- llama-swap - Local AI Model Swapping Proxy Service
- Pricing
- Free
- Editor rating
- 4.5 / 5
- Community saves
- 0
About llama-swap
llama-swap is an open-source proxy for hot-swapping local generative AI models across OpenAI-compatible and Anthropic-compatible servers. It gives local AI builders one API entry point for llama.cpp, vLLM, tabbyAPI, stable-diffusion.cpp, and similar backends.
Pros
- On-demand model loading and unloading through one proxy
- OpenAI-compatible and Anthropic-compatible API routing
- Works with llama.cpp, vLLM, tabbyAPI, stable-diffusion.cpp, and similar servers
- Web UI, logs, health checks, metrics, and running model inspection
- Configurable aliases, TTLs, request filters, macros, and lifecycle commands
Cons
Pricing
Open source
$0
- • Source code available on GitHub
- • Self-hosted or local usage path
- • No paid hosted plan confirmed in the source repository