See which AI crawlers visit your site, serve llms.txt automatically, and manage AI bot access. Everything stays in your own database.
Alternatives to Block eCommerce Assets via robots.txt
Plugins below are selected for functional relevance and current directory signals. Active-install counts do not affect this ranking.
WordPress plugins with similar use cases
Compatibility and update metadata provide context, not a quality guarantee. Review each plugin’s details for your site.
Block GPTBot, ClaudeBot, Bytespider and 170+ AI crawlers and scrapers, bot by bot. Blocks by user agent and robots.txt. Optional daily list updates.
Blocks the archive.org bots through the WordPress virtual robots.txt file.
See which AI crawlers request pages on your site, choose what each one is told, and check whether it took any notice.
Measure detected AI crawler activity, see which content is accessed, identify AI referral visits, and manage bot access locally.
See which AI crawlers read your site — GPTBot, ClaudeBot, PerplexityBot and more — verify they are who they claim, and block the ones you choose.
Intelligent AI crawler detection, traffic analytics, robots.txt control, AEO optimization, native IndexNow indexing, and AI firewall.
Can GPTBot, ClaudeBot, PerplexityBot and Googlebot reach your site? robots.txt per bot, a live test, a bot visit log and a weekly email alert.
Monitor identifiable AI crawler traffic and enforce access rules site-wide, per crawler, or per post, with optional llms.txt publishing.
A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.