WordPress.org

Qaraqalpaq tili

Get WordPress
WordPress.org

Plugin Directory

Plugin Tag: crawler

Plugin Tag: crawler

  • Robots.txt Extender

    (0 total ratings)

    Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.

    Humberto "Betto" Adami 10+ active installations Tested with 5.0.22

  • rexCrawler

    (0 total ratings)

    rexCrawler is a regular expression web-crawler plugin. Able to parse websites, save data and show them on pages.

    Lars Rasmussen 10+ active installations Tested with 3.0.5

  • JaspreetChahal’s wordpress bot detector lite

    (1 total ratings)

    This plugin detects a few bots (e.g. Google, Google ads, Alta vista etc) and sends an email based on interval set by you. you can choose what format e …

    Jaspreet Chahal 10+ active installations Tested with 4.2.38

  • SEObot Monitor for Googlebot, Bingbot and search engine spiders

    (0 total ratings)

    With SEObot Monitor for Googlebot you will be able to dump the server logs to Google Analytics, easily and automatically. This will allow you to dete …

    Buenamanera 10+ active installations Tested with 5.8.10

  • Page Modified

    (1 total ratings)

    Display the results of your Page Modified crawls right within your WordPress Admin.

    cklosows 10+ active installations Tested with 4.9.26