Free hosting servers with MySQL, PHP, cPanel & No ads!

Easily outrank any website for any keyword and dominate search engines like a PRO!
Smart website SEO strategy, optimization and competitor research - Free SEO tools does all it best!

Home » SEO Tools » Robots.txt Checker

Robots.txt Checker

Use Robots.txt Checker to spy the robots.txt file of almost any website.
Robots.txt Checker is very good for looking what web pages are forbidden for Google crawling, you may find some nice hidden pages that is not visible for crawlers and search engine results. Every SEO specialist should see inside of competitors robots.txt file. Also this tools will help you to create your own robots.txt file, by viewing other sites robots.txt sample.
How do I use this tool? [+]
  1. Enter URL of website that you want to spy fot robots.txt entries.
  2. Click Continue to get your results.