by Pagup 4.5 (102 reviews)

Better Robots.txt – AI-Ready Crawl Control & Bot Governance

Name: Better Robots.txt – AI-Ready Crawl Control & Bot Governance
Rating: 4.5 (102 reviews)
Author: Pagup

Replace the default WordPress robots.txt workflow with a smarter, structured version you can preview before publishing, with Free, Pro, and Premium ed …

Better Robots.txt ranks #3,047 among WordPress.org plugins with 5,000+ active installations, is #177 of 3,742 in the SEO & Marketing category, a 4.5/5 rating from 102 reviews, and was last updated Sep 13, 2026. Data from WordPress.org, refreshed twice daily — see methodology.

Tested up to WP 7.0.4 (Current: 7.1)

v3.1.3 Current Version v3.1.3

Updated 3 days ago Last Update on 13 Sep, 2026

Refreshed 6 hours ago Last Refreshed on

#177 of 3,742 in SEO & Marketing Top 5% by installs Downloads +664.2% this week Actively maintained

View on WordPress.org

Rank

#3,047

-1 this week

Active Installs

5K+

-14.5%

KW Avg Position

5.5

— No change

Downloads

326.6K

+41 today

Support Resolved

— No change

Rating

90%

Review 4.5 out of 5

4.5 (102 reviews)

Next Milestone 6K

Total Progress 77.6%

5K+ 6K+

Ranks to Climb

Growth Needed

8,000,000

Active Installs

Pro

Unlock Exact Install Count

See the precise estimated active installs for this plugin, calculated from real-time ranking data.

Exact install estimates within tiers
Track install growth over time
Milestone progress predictions

Upgrade to Pro

Need 224 more installs to reach 6K+

Rank Changes

Current #3,047

Change

Best #

Upgrade to Pro

Unlock 30-day and 90-day rank history charts with a Pro subscription.

Upgrade Now

Active Installs Growth

Upgrade to Pro

Active Installs 0,000,000+

Growth +0.0%

Peak 0,000,000

Downloads Growth

Downloads

Growth

Peak

Upgrade to Pro

Unlock 30-day, 90-day, and yearly download history charts with a Pro subscription.

Upgrade Now

Reviews & Ratings

4.5

102 reviews

Overall 90%

87 (85%)

2 (2%)

9 (9%)

Security History

Source: WPVulnerability

8 known vulnerabilities on record · 1 in the last 24 months · checked 2 days ago

Oct 16, 2024

Better Robots.txt – AI-Ready Crawl Control & Bot Governance [better-robots-txt] < 1.4.4

CVE-2022-4974 · Fixed in v1.4.4
Jul 18, 2023

Better Robots.txt – AI-Ready Crawl Control & Bot Governance [better-robots-txt] < 1.4.7

CVE-2023-33999 · Fixed in v1.4.7
Feb 14, 2023

Better Robots.txt – AI-Ready Crawl Control & Bot Governance [better-robots-txt] < 1.4.6

CVE-2023-25706 · Fixed in v1.4.6
Mar 4, 2022

Better Robots.txt – AI-Ready Crawl Control & Bot Governance [better-robots-txt] < 1.4.4

CVE-2022-4974 · Fixed in v1.4.4
Feb 28, 2022

Better Robots.txt – AI-Ready Crawl Control & Bot Governance [better-robots-txt] < 1.4.4

Fixed in v1.4.4
Feb 28, 2022

Better Robots.txt – AI-Ready Crawl Control & Bot Governance [better-robots-txt] < 1.4.4

Fixed in v1.4.4
Feb 25, 2019

Better Robots.txt – AI-Ready Crawl Control & Bot Governance [better-robots-txt] < 1.2.6

Fixed in v1.2.6
Better Robots.txt – AI-Ready Crawl Control & Bot Governance [better-robots-txt] < 1.2.6

Fixed in v1.2.6

Track This Plugin

Get detailed analytics, keyword tracking, and position alerts delivered to your inbox.

Start Tracking Free

Plugin Details

Version: 3.1.3
Last Updated: Sep 13, 2026
Requires WP: 5.0+
Tested Up To: 7.0.4
PHP Version: 7.4 or higher
Author: Pagup

Support & Rating

Rating: ★ ★ ★ ★ ★ 4.5
Reviews: 102
Support Threads: 0
Resolved: 0%

Keywords

AI Crawlers bot blocker llms.txt robots.txt seo

Upgrade to Pro

Unlock keyword rankings, search positions, and detailed analytics with a Pro subscription.

Upgrade Now

Similar Plugins

Adminify – White Label, Admin Menu Editor, Login Customizer

6K+ installs

#2,751

Master Addons for Elementor – Elementor Addons, Widgets, Mega Menu Builder, Popup Builder, Widget Builder & Template Kits

30K+ installs

#1,006

Yoast SEO - Advanced SEO with real-time guidance and built-in AI

10M+ installs

$Rank Math SEO – AI SEO Tools to Dominate SEO Rankings$

Rank Math SEO – AI SEO Tools to Dominate SEO Rankings

4M+ installs

#13

All in One SEO – AI SEO Plugin to Boost SEO Rankings & Traffic (Schema, Local SEO, Sitemap & SEO Insights)

MC4WP: Mailchimp for WordPress

1M+ installs

#34

Hostinger Reach – AI-Powered Email Marketing for WordPress

1M+ installs

#44

XML Sitemap Generator for Google

View all Seo-and-marketing plugins

TL;DR

AI summary of the plugin's readme

This plugin is for WordPress site owners who want more control over how search engines, AI crawlers, and other bots interact with their site, from beginners to advanced users managing SEO and WooCommerce stores. It replaces the default blank robots.txt textarea with a guided wizard, presets, and a review step so users can configure and preview crawl rules before publishing.

Guided step-by-step wizard
Preset-based setup (Essential, AI-First, Fortress, Custom)
AI and LLM crawler governance
AI usage signals support
WooCommerce crawl cleanup options
Archive and Wayback access controls
ads.txt and app-ads.txt allowance
Final Review & Save preview screen

Frequently Asked Questions

Common questions about Better Robots.txt – AI-Ready Crawl Control & Bot Governance

Yes. Better Robots.txt generates and manages your WordPress robots.txt through a guided interface, with a preview before you apply changes.

No. The plugin is designed for both beginners and advanced users. Presets make the first setup easy, while experts can fine-tune individual modules and directives.

Yes. The final Review & Save step shows you the generated robots.txt before you publish it.

You can configure how AI-related crawlers and tools are treated and publish AI usage preferences. Respect and enforcement still depend on each crawler's behavior, just like with robots.txt.

No. llms.txt and similar policy signals help you express intent more clearly, but they are not a hard technical barrier.

Yes. Better Robots.txt helps you differentiate between crawler categories instead of using a simple all-or-nothing approach.

Yes. Presets are a starting point. You can revisit the settings page, adjust modules, and regenerate your robots.txt at any time.

No. The screenshots reflect the current product family and may include Free, Pro, and Premium features. Features marked Pro or Premium in the interface require a paid edition.

Yes. The free edition includes the guided workflow, essential crawl control, and the final preview step. Pro and Premium are for sites that need broader governance and stricter protection.

Yes. Better Robots.txt includes WooCommerce-related cleanup options to reduce unnecessary crawling of dynamic, low-value, or duplicate URLs.