Skip to content
Live data
Blocks an AI crawler 10%Blocks GPTBot 9.6%ads.txt 22%Cookie consent banner 19%Ad pixels 23%llms.txt 15%HTTPS homepage 98%DMARC record 64%Blocks an AI crawler 10%Blocks GPTBot 9.6%ads.txt 22%Cookie consent banner 19%Ad pixels 23%llms.txt 15%HTTPS homepage 98%DMARC record 64%
TNP.media
  1. Home
  2. Tools
  3. robots.txt tester
Runs in your browserSEO & publishing

robots.txt tester

Paste the file, enter paths and bots, and see which rule decides.

Runs locally — nothing is uploaded
Result
Nothing yet — enter data or press Example.

How to use

  1. 1Paste the robots.txt content.
  2. 2Enter the paths and the bots you care about.
  3. 3Read the verdict and the rule that matched.

The most specific (longest) matching rule. If Allow and Disallow are equally long, Allow wins.

No, it only tests the text you paste. Use the live robots checker to fetch a site’s file.

Got a story or an ad stack to fix?

Write to the desk — we reply within one business day.