FoundByAI — LLMs.txt & AI Bot Tracking
by thenooch 0 (0 reviews)

FoundByAI — LLMs.txt & AI Bot Tracking

See whether AI crawlers can actually reach your WordPress site, and what happens when they do. Access test, real AI bot logs, optional llms.txt.

FoundByAI ranks #34,588 among WordPress.org plugins with 10+ active installations, is #1,371 of 4,265 in the SEO & Marketing category, and was last updated Oct 26, 2026. Data from WordPress.org, refreshed twice daily — see methodology.

Compatible with WP 7.1.4
v1.3.11 Current Version v1.3.11
Updated 1 week ago Last Update on 26 Oct, 2026
Refreshed 1 week ago Last Refreshed on
#1,371 of 4,265 in SEO & Marketing Top 50% by installs Downloads -59.2% this week Actively maintained
View on WordPress.org
Rank
#34,588
— No change
Active Installs
10+
— No change
KW Avg Position
147.3
— No change
Downloads
1.2K
+7 today
Support Resolved
0%
— No change
Rating
0%
Review 0 out of 5
0 (0 reviews)

Next Milestone 20

Total Progress 70%
10+ 20+
11,415
Ranks to Climb
-
Growth Needed
8,000,000
Active Installs
Pro

Unlock Exact Install Count

See the precise estimated active installs for this plugin, calculated from real-time ranking data.

  • Exact install estimates within tiers
  • Track install growth over time
  • Milestone progress predictions
Upgrade to Pro
Need 3 more installs to reach 20+

Rank Changes

32,859 33,723 34,588 35,453 36,317 31-10-2026 01-11-2026 02-11-2026 03-11-2026 04-11-2026 05-11-2026 06-11-2026 07-11-2026
30,193 35,317 40,441 45,565 50,689 23-10-2026 24-10-2026 25-10-2026 26-10-2026 27-10-2026 28-10-2026 29-10-2026 30-10-2026 31-10-2026 01-11-2026 02-11-2026 03-11-2026 04-11-2026 05-11-2026 06-11-2026 07-11-2026
Current #34,588
Change
Best #

Upgrade to Pro

Unlock 30-day and 90-day rank history charts with a Pro subscription.

Upgrade Now

Active Installs Growth

Active Installs 0,000,000+
Growth +0.0%
Peak 0,000,000

Downloads Growth

0 10 20 31-10-2026 01-11-2026 02-11-2026 03-11-2026 04-11-2026 05-11-2026 06-11-2026 07-11-2026
0 10 20 30 40 50 23-10-2026 24-10-2026 25-10-2026 26-10-2026 27-10-2026 28-10-2026 29-10-2026 30-10-2026 31-10-2026 01-11-2026 02-11-2026 03-11-2026 04-11-2026 05-11-2026 06-11-2026 07-11-2026
Downloads
Growth
Peak

Upgrade to Pro

Unlock 30-day, 90-day, and yearly download history charts with a Pro subscription.

Upgrade Now

Reviews & Ratings

0.0
0 reviews
Overall 0%
5
0 (0%)
4
0 (0%)
3
0 (0%)
2
0 (0%)
1
0 (0%)

Support Threads Overview

Resolved
Unresolved
2
Total Threads
0
Resolved
2
Unresolved
0%
Resolution Rate

Frequently Asked Questions

Common questions about FoundByAI — LLMs.txt & AI Bot Tracking

llms.txt is a proposed index file (like robots.txt, but for language models) that lists the pages on your site that matter most, with links to clean Markdown versions. It is optional and unproven: Google Search ignores it, and no major AI search product has confirmed that it reads it. Some coding agents and developer tools do read it. FoundByAI generates and maintains one for you at no cost, but it is not the reason to install the plugin.
It detects the main AI training, search and user-triggered crawlers from OpenAI, Anthropic, Perplexity, Apple and others. The full list is on the Bot Activity -> Bots tab, where you can enable or disable any bot and add your own patterns with the sfab_register_bots filter.
Browsers are forgiving and AI fetchers are not. The usual causes are a firewall or CDN (Cloudflare, Sucuri, your host's WAF) that challenges or blocks the crawlers' user agents, a redirect loop, or a chain of hops such as https -> http -> https that a browser follows but an AI fetcher gives up on. The AI Access test on the Bot Activity -> Bots tab requests your site with each crawler's user agent and follows redirects on your homepage and recent posts, then shows which ones are blocked and which pages redirect badly. The test runs from our server, not from OpenAI's or Anthropic's, so a WAF that filters by IP address can still treat the real crawlers differently.
Training crawlers (for example GPTBot and ClaudeBot) collect content in the background for model training. Blocking them does not stop AI assistants from reading your site today. Search crawlers (for example OAI-SearchBot, Claude-SearchBot and PerplexityBot) build the index that AI search products cite from. User-triggered fetchers (for example ChatGPT-User, Claude-User and Perplexity-User) load a page when a person asks an assistant about it. Blocking a search or user-triggered bot means that product cannot cite or open your page.
No. Google-Extended and Applebot-Extended are robots.txt control tokens, not crawlers. They tell Google and Apple whether content the normal crawlers (Googlebot, Applebot) already fetched may be used for AI training. They never make a request of their own, so they cannot appear in a visit log.
llms.txt is enabled by default after activation. Visit SEO for AI Bots > Discovery to: * Preview your llms.txt file * Add pinning rules (boost posts by tag, category, or ID) * View posts that will be included
Yes, three ways: 1. Global threshold: Settings > Content sets minimum word count (default 200) 2. Per-post checkbox: Edit any post to include/exclude from llms.txt 3. Pinning rules: Settings > Discovery to boost specific posts or categories
/.md URLs (e.g., /my-post.md): Individual post downloads in Markdown format /llms.txt: Directory file listing your best posts for AI crawler discovery
Only one llms.txt can win. Some plugins write a real file into your site's root folder, and your web server hands that file to AI crawlers before WordPress even loads — so it silently overrides the one FoundByAI builds, whatever your settings say. FoundByAI detects this and tells you, rather than quietly competing. If you'd rather use FoundByAI's version, turn the other plugin's llms.txt setting off first (otherwise it will write the file again on its next scheduled run), then use the "Remove the file" button in the notice to clear the leftover. FoundByAI's llms.txt differs in a few ways: it can list every page you choose rather than a fixed handful, it links to clean Markdown versions instead of your HTML pages, it gives each link a description, it rebuilds the moment you publish, and it can order entries by which pages AI crawlers actually read on your site. If you prefer the other plugin's file, that's fine too — just switch FoundByAI's llms.txt off in Settings > Discovery.
3-tier system: 1. SEO Score (0-1000 points): From your SEO plugin (Yoast, Rank Math, etc.) 2. Post Date (0-100 points): Newer posts get higher score, decays over 1 year 3. Manual Pins (highest): Boost specific posts or categories

Sign In / Register

You need to sign in or register to use this feature.