WordPress.org

Dansk

Få WordPress
WordPress.org

Plugin Directory

Plugin-tag: crawler

Plugin-tag: crawler

  • Email Address Encoder

    (160 totale bedømmelser)

    A lightweight plugin that protects email addresses from email-harvesting robots, by encoding them into decimal and hexadecimal entities.

    Till Krüss 100.000+ aktive installationer Testet med 7.0.3

  • Robots.txt Editor

    (8 totale bedømmelser)

    Robots.txt for WordPress

    Processby 10.000+ aktive installationer Testet med 5.6.18

  • No-Bot Registration

    (28 totale bedømmelser)

    Prevent bots from creating accounts by blacklisting domains and usernames and present people with a human friendly security question.

    Arnan 2.000+ aktive installationer Testet med 6.9.6

  • Robots.txt rewrite

    (2 totale bedømmelser)

    Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.

    Eugen Bobrowski 1.000+ aktive installationer Testet med 4.7.34

  • Marquee image crawler

    (1 totale bedømmelser)

    Marquee image crawler is a continuous scrolling image plugin. This plugin crawls the images left or right.

    gopiplus 600+ aktive installationer Testet med 6.1.11

  • Block Archive.org via WordPress robots.txt

    (0 totale bedømmelser)

    Blocks the archive.org bots through the WordPress virtual robots.txt file.

    apasionados 400+ aktive installationer Testet med 6.9.6

  • Bisteinoff SEO Robots.txt

    (4 totale bedømmelser)

    An easy-to-use plugin that generates and configures a proper robots.txt file, essential for effective search engine optimization (SEO).

    Denis Bisteinov 400+ aktive installationer Testet med 6.9.6

  • Mass Ping Tool for SEO – WordPress ping list to get indexed faster on Google, Yandex, …

    (4 totale bedømmelser)

    Mass ping tool for SEO plugin is one of the fastest ways to get indexed by Google. After pinging, Google bots, crawlers will visit your website and in …

    Pagup 400+ aktive installationer Testet med 7.0.3

  • Block Chat GPT via robots.txt

    (1 totale bedømmelser)

    Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file

    apasionados 100+ aktive installationer Testet med 6.3.9

  • bodi0`s Bots visits counter

    (5 totale bedømmelser)

    Counts the visits from web spiders, crawlers and bots in your blog, with ability to get the blog rankings.

    Budiony Damyanov 100+ aktive installationer Testet med 6.1.11

  • Block eCommerce Assets via robots.txt

    (0 totale bedømmelser)

    Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt

    apasionados 100+ aktive installationer Testet med 6.3.9

  • Warmer – Cache Warmer and Cache Preload Crawler

    (6 totale bedømmelser)

    Warm your WordPress cache with scheduled crawling, cache preloading, URL source control, logs, diagnostics, and WP-CLI.

    Atakan Oz 70+ aktive installationer Testet med 7.0.3

  • Findkit – Site Search

    (0 totale bedømmelser)

    Powerful cloud based search engine for your website. Search as you type, real-time index updates, and embeddable UI. Free for small websites.

    Findkit Team 60+ aktive installationer Testet med 6.9.0

  • EdgeShaping Lite

    (0 totale bedømmelser)

    Observe which AI bots visit which pages and when. WordPress implementation of the EdgeShaping framework.

    mareinterno 40+ aktive installationer Testet med 7.0.3

  • AI Deny

    (1 totale bedømmelser)

    Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.

    Code For Broke 40+ aktive installationer Testet med 6.9.6

  • Boring Cache Warmup Lite

    (2 totale bedømmelser)

    A lightweight, privacy-friendly WordPress cache warmup tool. No external services, no drama.

    chriskubisch 30+ aktive installationer Testet med 7.0.3

  • Berq Markdown: Markdown Pages for AI & LLM Crawlers

    (0 totale bedømmelser)

    Increase your AI visibility. Berq Markdown serves every page as a clean Markdown file so AI assistants and LLM crawlers can read, cite, and recommend …

    BerqWP 30+ aktive installationer Testet med 7.0.3

  • Block Common Crawl via robots.txt

    (0 totale bedømmelser)

    Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file

    apasionados 30+ aktive installationer Testet med 6.3.9

  • Block Feed and Comments via robots.txt

    (0 totale bedømmelser)

    Blocks some Feed and Comment resources in order to avoid spam bots

    apasionados 20+ aktive installationer Testet med 6.3.9

  • Adriano GEO Context and Crawl Monitor

    (0 totale bedømmelser)

    Optimize your WordPress site for AI search engines. Serves a virtual AI context endpoint, injects JSON-LD schema, and tracks AI crawler visits.

    adriano 20+ aktive installationer Testet med 7.0.3