AI Crawler Honeypot
A public log tracking automated AI agent requests to websites
About
The AI Crawler Honeypot is a specialized web service that creates a public, anonymized log of requests made by automated AI agents and web crawlers to its domain. It serves as a transparency tool and research platform for developers, security professionals, and AI researchers interested in understanding the behavior, frequency, and origins of non-human, AI-powered traffic on the web. The system protects privacy by never storing real client IP addresses, instead providing aggregated, anonymized data accessible via a public log. It helps website owners and developers identify patterns in AI agent interactions, monitor for potentially malicious automated activity, and research the evolving landscape of AI-powered web scraping and interaction.
Key features
- Public, anonymized log of AI agent requests
- Real client IPs are never stored for privacy
- Daily log accessible at a public URL (/log/today)
- Designed specifically to track non-human, AI-powered traffic
- Serves as a transparency and research tool
Use cases
- Monitoring and researching AI agent traffic patterns on the web
- Identifying automated AI crawlers for security analysis
- Providing transparency data for developers on AI web interactions
- Serving as a reference dataset for AI agent behavior studies
- Helping website administrators understand non-human traffic sources
