check the robots.txt content on websites with one click.
What is robots.txt viewer?
Robots.txt Viewer is a Firefox add-on that enables users to easily examine the source of robots.txt files on websites and view their content directly. It offers features like robots.txt caching, privacy settings, and access to a public robots.txt file archive.
Inspect the source of every robots.txt file from the current website in your browser and display the content directly. With robots.txt caching, privacy settings and public robots.txt file archive.
:: Full changelog https://www.robots-viewer.com/changelog
:: Public stats https://www.robots-viewer.com/statistics
robots.txt viewer is relatively safe to use as it requires very minimum permissions.
robots.txt viewer has earned a fairly good reputation and likely can be trusted.