Runs locally — nothing is uploaded
Result
Nothing yet — enter data or press Example.
How to use
- 1Choose whether bots may crawl by default.
- 2List the paths that should stay out of search.
- 3Pick a policy for AI crawlers and add your sitemap.
No. It asks well-behaved crawlers not to fetch them; blocked URLs can still appear in search if linked. Use noindex or authentication for privacy.
No, Google ignores it. Bing and some others respect it.
Related tools
SERP snippet previewPreview title and description in searchOpen Graph generatorSocial share tags with a previewads.txt validatorCheck ads.txt syntax line by lineSchema.org generatorStructured data in JSON-LDrobots.txt testerIs this path allowed for this bot?Keyword density checkerWord and phrase frequency in a text
Got a story or an ad stack to fix?
Write to the desk — we reply within one business day.