Skip to content
Live data
Blocks an AI crawler 10%Blocks GPTBot 9.6%ads.txt 22%Cookie consent banner 19%Ad pixels 23%llms.txt 15%HTTPS homepage 98%DMARC record 64%Blocks an AI crawler 10%Blocks GPTBot 9.6%ads.txt 22%Cookie consent banner 19%Ad pixels 23%llms.txt 15%HTTPS homepage 98%DMARC record 64%
TNP.media
  1. Home
  2. Data
  3. Sitemaps & feeds
68,769 sitesGlobal

XML sitemap & RSS feed statistics worldwide

sitemap.xml, feeds and other machine-readable entry points.

68%
sitemap.xml
46,535 / 68,769
68%
Sitemap in robots.txt
38,099 / 56,191
65%
robots.txt
56,191 / 85,917
15%
llms.txt
10,279 / 68,769

By market

MetricGlobalUnited KingdomNetherlandsItalySpainJapanLatin America
sitemap.xml68%77%77%72%72%58%67%
Sitemap in robots.txt68%86%87%69%70%64%73%
robots.txt65%80%84%70%72%43%61%
llms.txt15%17%14%14%14%7.4%18%
security.txt8.4%5.3%21%3.2%3.5%0.9%4.5%
RSS/Atom feed18%22%20%28%23%14%23%

Our crawler: 68,769 sites · Global · updated Oct 23, 2026 · Methodology

Got a story or an ad stack to fix?

Write to the desk — we reply within one business day.