Pluginaren Etiketa: crawlers
-
-
Robots.txt rewrite
(2 balorazioak)Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.
-
AI Content Signals
(3 balorazioak)Control how AI uses your content — search, AI answers or training — via robots.txt Content Signals, HTTP headers, meta tags and TDMRep.
-
CodingBunny LLMs.txt Generator
(1 balorazioak)Advanced llms.txt generator with AI metadata, Schema.org types, canonical URLs, and differentiated licenses for optimal LLM indexing.
-
Robots Meta Whiz
(0 balorazioak)Easy way to discourage search engines from indexing only specific pages / posts with custom meta tags.
-
-
Serve Markdown
(0 balorazioak)Serve Markdown versions of your posts and pages to AI agents and crawlers. Content negotiation, .md URLs, auto-discovery, and crawler logging.
-
ParseLess
(0 balorazioak)Serve AI the good version of your content, see which bots really read it, and cap what they cost you. Markdown for crawlers and agents — 95%+ less ban …
-
Log-Hero.com Plugin
(2 balorazioak)See which search engines, AI crawlers and other bots visit your site, and what they find. The official plugin for log-hero.com.
-
CeeWP Robots.txt Manager
(0 balorazioak)Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
-
AMDT AI Traffic Analytics
(0 balorazioak)See which AI bots crawl your site, whether they are who they claim to be, and who arrives from ChatGPT, Claude or Perplexity. Publishes llms.txt.
-
Temso AI
(0 balorazioak)Stream front-end request logs from your WordPress origin to Temso so AI-crawler and bot traffic shows up in your dashboard.
-
Seo Crawlytics Data Export & Delete
(0 balorazioak)Exports all entries of Seo Crawlytics and gives you the option to delete the entries that are older than 1 month.
-
OtterlyAI Agent Analytics
(0 balorazioak)Reports every AI crawler and bot request on your site to OtterlyAI Agent Analytics. Runs server-side, in the background.
-
MSG LLMs TXT Manager
(0 balorazioak)Serve your content as clean Markdown to AI agents, publish llms.txt and llms-full.txt, and see which agents actually fetch what.
-
LJPL Armored robots.txt
(0 balorazioak)Add some directives to your robots.txt file to keep your site safer
-
PufferSights – AI Crawler Insights
(0 balorazioak)Monitor 135+ known AI crawlers and agents with local analytics, AI referrals, llms.txt, and opt-in robots.txt policy tools.
-
Rawi MD — Markdown for AI Crawlers
(0 balorazioak)Give ChatGPT, Claude and other AI crawlers a clean Markdown copy of your posts, pages and products. Nothing changes for your visitors.
-
AI Rights Protection by SimpleFeed
(1 balorazioak)Protect your rights by reviewing and blocking AI bots from using your content without compensation.
-
Referenced – AI Crawler Tracking
(0 balorazioak)See which AI crawlers (GPTBot, ClaudeBot, PerplexityBot and more) read which pages of your site. No visitor data, no front-end changes.