WordPress.org

Xhosa

Get WordPress
WordPress.org

Plugin Directory

Plugin Tag: crawler

Plugin Tag: crawler

  • Azayem Bots Tracker – Bot Visits Logger

    (0 total ratings)

    A custom plugin to log search engine bot visits and analyze their crawl budget directly inside WordPress (no external services required).

    botstracker 20+ active installations Tested with 6.9.7

  • Trackbase Analytics

    (0 total ratings)

    Official Trackbase Analytics plugin for WordPress. Add your tracking ID and enable server-side crawler analytics in minutes.

    trackbase 10+ active installations Tested with 7.0.4

  • GlobeSign Content Markdown Mirror

    (0 total ratings)

    Makes your WordPress site AI-friendly: generates llms.txt and clean, structured Markdown mirrors of every page and post.

    globesign 10+ active installations Tested with 7.0.4

  • SEObot Monitor for Googlebot, Bingbot and search engine spiders

    (0 total ratings)

    With SEObot Monitor for Googlebot you will be able to dump the server logs to Google Analytics, easily and automatically. This will allow you to dete …

    Santiago Alonso 10+ active installations Tested with 5.8.15

  • Page Modified

    (1 total ratings)

    Display the results of your Page Modified crawls right within your WordPress Admin.

    Chris Klosowski 10+ active installations Tested with 4.9.31

  • Robots.txt Extender

    (0 total ratings)

    Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.

    bettoadami 10+ active installations Tested with 5.0.27

  • JaspreetChahal’s wordpress bot detector lite

    (1 total ratings)

    This plugin detects a few bots (e.g. Google, Google ads, Alta vista etc) and sends an email based on interval set by you. you can choose what format e …

    Jaspreet Chahal 10+ active installations Tested with 4.2.39

  • AI Crawler Guard

    (0 total ratings)

    Detect and control AI crawler access with local logging and history.

    aicrawlerguard.com Fewer than 10 active installations Tested with 6.9.7

  • Virtual LLMS.TXT Generator

    (0 total ratings)

    Safely creates a virtual llms.txt dynamically. Features interactive bot targeting, map auto-syncing, and decoupled custom instructions.

    Alex Oreshkin Fewer than 10 active installations Tested with 7.0.4

  • URLs Most Wanted for LiteSpeed LScache

    (0 total ratings)

    A demand-driven sitemap for LiteSpeed Cache warmup. Record the URLs visitors actually use and warm only what people need.

    imedes Fewer than 10 active installations Tested with 7.1

  • Pixellize Site Issue Scanner

    (2 total ratings)

    Powerful SEO auditor by Pixellize. Crawls your site to fix broken links, missing meta tags, and unoptimized images.

    Pixellize Fewer than 10 active installations Tested with 7.0.4

  • Whizz MD — Markdown Endpoints for AI Crawlers

    (0 total ratings)

    Serve every WordPress post and page as a clean .md file with full SEO frontmatter — discoverable by AI crawlers and search engines on the fly.

    Whizz People Fewer than 10 active installations Tested with 7.0.4

  • FocusWeb AI Crawler Monitor – Track, Verify & Block AI Bots

    (0 total ratings)

    Track, verify and block AI crawlers (GPTBot, ClaudeBot, PerplexityBot). Spot spoofed bots, control robots.txt, measure AI referral traffic.

    Uri N. Fewer than 10 active installations Tested with 7.0.4

  • WEO LLMS & AI Crawler Guide

    (2 total ratings)

    The professional architect for your llms.txt file. Control how AI agents (ChatGPT, Claude, Perplexity) consume your website content with a structured, …

    Md Atiar Rahman Ovi Fewer than 10 active installations Tested with 6.9.7

  • Cleotic AI Traffic

    (0 total ratings)

    See AI crawler visits and AI assistant referrals on your site, with optional signed sync to Cleotic.

    cleotic Fewer than 10 active installations Tested with 7.0.4

  • Trimardeau SEO Log

    (0 total ratings)

    Google crawls you. AIs read you. See everything: search engine and AI crawler analytics for every post, page and term.

    Nicolas TRIMARDEAU Fewer than 10 active installations Tested with 7.0.4

  • OpenBotAuth – AI Crawler Access Control

    (0 total ratings)

    Verify AI crawlers with HTTP Signatures and enforce allow/deny/teaser policies; also serves llms.txt and AI-ready feeds.

    hammadtq Fewer than 10 active installations Tested with 6.9.7

  • Bottoll – AI Crawler Control

    (0 total ratings)

    Detect AI crawlers, apply access policies, and understand automated access to your WordPress content.

    bottoll Fewer than 10 active installations Tested with 7.0.4

  • OtterFixer AI Bot Tracker

    (0 total ratings)

    A lightweight plugin that logs visits from common AI/LLM crawler user-agents and shows a simple report in wp-admin.

    OtterFixer Fewer than 10 active installations Tested with 6.9.7

  • Aiso AI Crawler Analytics

    (0 total ratings)

    See which AI assistants — ChatGPT, Claude, Perplexity, Google and more — crawl your site, broken down by assistant, crawler, purpose and page.

    bentannenbaum Fewer than 10 active installations Tested with 7.0.4