See which AI crawlers visit your site, serve llms.txt automatically, and manage AI bot access. Everything stays in your own database.
Alternatives to Block Archive.org via WordPress robots.txt
Plugins below are selected for functional relevance and current directory signals. Active-install counts do not affect this ranking.
Relevant replacements
WordPress plugins with similar use cases
Compatibility and update metadata provide context, not a quality guarantee. Review each plugin’s details for your site.
Block GPTBot, ClaudeBot, Bytespider and 170+ AI crawlers and scrapers, bot by bot. Blocks by user agent and robots.txt. Optional daily list updates.
See which AI crawlers request pages on your site, choose what each one is told, and check whether it took any notice.
Measure detected AI crawler activity, see which content is accessed, identify AI referral visits, and manage bot access locally.
See which AI crawlers read your site — GPTBot, ClaudeBot, PerplexityBot and more — verify they are who they claim, and block the ones you choose.
An easy-to-use plugin that generates and configures a proper robots.txt file, essential for effective search engine optimization (SEO).
VisitorTypev0.2.0
Verified AI crawler analytics: claimed bots are checked against vendor IP ranges — impostors get flagged. Fire different tags per visitor type.
Choose which AI bots can read your content, and publish an llms.txt file for AI search tools.
Can GPTBot, ClaudeBot, PerplexityBot and Googlebot reach your site? robots.txt per bot, a live test, a bot visit log and a weekly email alert.
OwlyCrackGeov1.6.0
Intelligent AI crawler detection, traffic analytics, robots.txt control, AEO optimization, native IndexNow indexing, and AI firewall.