SEO

robots.txt Validator

Check robots.txt — User-agent group structure, directives, and a path tester for allow/block decisions.

If you enter just a domain, /robots.txt is appended. This won't work for every site — some block cross-origin requests (CORS); if fetching fails, open robots.txt in a new tab and paste the contents manually.