Dark Visitors Plugin
Track and control artificial agents crawling your website including AI assistants, scrapers, search crawlers, and other bots.
Half of your website’s traffic is invisible to you. It comes from the hidden ecosystem of AI assistants, scrapers, search crawlers, and other bots swarming across the internet. Dark Visitors lets you analyze, protect, and optimize your content for these artificial agents, which are becoming more intelligent every day.
This plugin connects your website to Dark Visitors.
Features
- Expose Your Hidden Page Views: Get realtime insight into the increasingly meaningful activity of artificial agents that other analytics platforms hide from you.
- Spot Emerging AI Trends: See when people are using AI assistants or autonomous agents to access your website on their behalf.
- Protect Your Content From Scraping: Generate a robots.txt that automatically stays up to date with the latest agents. Block the ones who try to break the rules.
- Identify Top Agents and Pages: See which agents visit your website the most, and which of your pages they’re most interested in.
- Connect Your Website in Seconds: Set up agent analytics and your robots.txt using the simple API or WordPress plugin.
Demos
Links to demos can be found on the home page.
Installation
- Install and activate the Dark Visitors plugin from the WordPress Plugin Directory
- Sign up for Dark Visitors and create a new project for your website.
- Copy your access token from the project’s settings page, then paste it into the access token field on the plugin’s configuration page.
Your website is now connected to Dark Visitors.
Screenshots
An overview of all agent activity on the website
A timeline of all agent visits to the website
Insights into an agent's activity on the website
Insights into agents who are not following the website's robots.txt rules
Agent details including insight into how many websites are blocking it
FAQ
Yes. Setting up an account only takes a few seconds. This is where you’ll be able to see insights into agent activity on your website.
Dark Visitors is a freemium service. Most websites use fewer events than the free event usage limit. Larger websites only pay for what they use. More detail can be found on the pricing page.
Examples include GPTBot, CCBot, Claudebot, PerplexityBot, Googlebot, etc. See the full agent list for more.
There are many reasons. Their activity affects:
- Whether your content is used in AI model training
- If your users can use AI assistants to access your website
- How your pages appear in search engine results
- Server resource usage
- Etc.
Changelog
1.4.0
- Added the option to block agents
1.3.0
- Added a small edge case fix
1.2.0
- Updated copy
1.1.0
- Added the ability to disable analytics
1.0.0
- Initial release