Skip to content
Live data
Blocks an AI crawler 12%Blocks GPTBot 11%ads.txt 22%Cookie consent banner 20%Ad pixels 23%llms.txt 15%HTTPS homepage 99%DMARC record 65%Blocks an AI crawler 12%Blocks GPTBot 11%ads.txt 22%Cookie consent banner 20%Ad pixels 23%llms.txt 15%HTTPS homepage 99%DMARC record 65%
TNP.media
  1. Home
  2. Data
  3. Sitemaps & feeds
68,167 sitesGlobal

XML sitemap & RSS feed statistics worldwide

sitemap.xml, feeds and other machine-readable entry points.

67%
sitemap.xml
45,554 / 68,167
66%
Sitemap in robots.txt
35,857 / 53,980
63%
robots.txt
53,980 / 86,147
15%
llms.txt
10,287 / 68,167

By market

MetricGlobalUnited KingdomNetherlandsItalySpainJapanLatin America
sitemap.xml67%76%76%69%67%58%65%
Sitemap in robots.txt66%88%87%68%70%64%71%
robots.txt63%78%78%63%59%43%58%
llms.txt15%13%11%12%13%5.9%18%
security.txt8.6%5.2%20%3.1%3.7%0.8%5%
RSS/Atom feed18%26%25%28%24%14%23%

Our crawler: 68,167 sites · Global · updated Nov 13, 2026 · Methodology

Got a story or an ad stack to fix?

Write to the desk — we reply within one business day.