SEO
robots.txt Validator
Check robots.txt — User-agent group structure, directives, and a path tester for allow/block decisions.
If you enter just a domain, /robots.txt is appended. This won't work for every site — some block cross-origin requests (CORS); if fetching fails, open robots.txt in a new tab and paste the contents manually.