About this plugin
Msite AI Crawler Monitor shows you how AI engines treat your website.
Bot statistics
- Logs visits from known AI crawlers: GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, Claude-User, PerplexityBot, Perplexity-User, Google-Extended, GoogleOther, Bytespider, Amazonbot and Meta’s external agent.
- Separates learning scans (crawlers that build an index or training set) from real-time queries (requests sent the moment a person asks an AI a question).
- Period filter (7 days, 30 days, 3 months, year, all time), per-bot table, donut charts and the top pages visited by bots.
AI Health check
txt, Schema JSON-LD and canonical tag. Each check is shown as a traffic-light card with a short explanation.
Pro add-on (separate, optional)
A separate Pro add-on adds an AI-readable content layer (Quick Facts, FAQ, schema), FAQ drafting with your own AI API key, Google Analytics 4 AI referrals and a readiness score. It is a different plugin, licensed personally for now. This plugin works fully without it and contains none of its code.
Hebrew first
org) and uses logical CSS so it looks right in both RTL and LTR admin screens.
External services
This plugin does not send data to any external service. txt). Links shown next to check results (for example to Google’s documentation) are plain links that open only when you click them.
Privacy
The plugin stores only a daily counter per bot and page (date, bot name, post ID, number of visits). It does not store IP addresses or full user-agent strings, and it does not log logged-in users.
Bots are recognised by the name in their User-Agent header, which any client can fake, so treat the numbers as indicative.
Third-party libraries
- Chart.js 4.5.1 (MIT License), bundled locally in assets/vendor/. Source: https://www.chartjs.org