Checks robots.txt, page-level crawler directives, and responses to documented ChatGPT and Claude crawler user-agent names without login; it cannot verify official provider IPs.
This is a directory listing. We have not independently tested the tool or its current limits. Check the provider website before uploading sensitive files.