Plugin-tag: crawlers
-
-
Robots.txt rewrite
(2 totale bedømmelser)Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.
-
AI Content Signals
(3 totale bedømmelser)Control how AI uses your content — search, AI answers or training — via robots.txt Content Signals, HTTP headers, meta tags and TDMRep.
-
CodingBunny LLMs.txt Generator
(1 totale bedømmelser)Advanced llms.txt generator with AI metadata, Schema.org types, canonical URLs, and differentiated licenses for optimal LLM indexing.
-
Robots Meta Whiz
(0 totale bedømmelser)Easy way to discourage search engines from indexing only specific pages / posts with custom meta tags.
-
-
Serve Markdown
(0 totale bedømmelser)Serve Markdown versions of your posts and pages to AI agents and crawlers. Content negotiation, .md URLs, auto-discovery, and crawler logging.
-
ParseLess
(0 totale bedømmelser)Serve AI the good version of your content, see which bots really read it, and cap what they cost you. Markdown for crawlers and agents — 95%+ less ban …
-
Log-Hero.com Plugin
(2 totale bedømmelser)See which search engines, AI crawlers and other bots visit your site, and what they find. The official plugin for log-hero.com.
-
CeeWP Robots.txt Manager
(0 totale bedømmelser)Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
-
AMDT AI Traffic Analytics
(0 totale bedømmelser)See which AI bots crawl your site, whether they are who they claim to be, and who arrives from ChatGPT, Claude or Perplexity. Publishes llms.txt.
-
Temso AI
(0 totale bedømmelser)Stream front-end request logs from your WordPress origin to Temso so AI-crawler and bot traffic shows up in your dashboard.
-
Seo Crawlytics Data Export & Delete
(0 totale bedømmelser)Exports all entries of Seo Crawlytics and gives you the option to delete the entries that are older than 1 month.
-
OtterlyAI Agent Analytics
(0 totale bedømmelser)Reports every AI crawler and bot request on your site to OtterlyAI Agent Analytics. Runs server-side, in the background.
-
MSG LLMs TXT Manager
(0 totale bedømmelser)Serve your content as clean Markdown to AI agents, publish llms.txt and llms-full.txt, and see which agents actually fetch what.
-
LJPL Armored robots.txt
(0 totale bedømmelser)Add some directives to your robots.txt file to keep your site safer
-
PufferSights – AI Crawler Insights
(0 totale bedømmelser)Monitor 135+ known AI crawlers and agents with local analytics, AI referrals, llms.txt, and opt-in robots.txt policy tools.
-
Rawi MD — Markdown for AI Crawlers
(0 totale bedømmelser)Give ChatGPT, Claude and other AI crawlers a clean Markdown copy of your posts, pages and products. Nothing changes for your visitors.
-
AI Rights Protection by SimpleFeed
(1 totale bedømmelser)Protect your rights by reviewing and blocking AI bots from using your content without compensation.
-
Referenced – AI Crawler Tracking
(0 totale bedømmelser)See which AI crawlers (GPTBot, ClaudeBot, PerplexityBot and more) read which pages of your site. No visitor data, no front-end changes.