Site Crawler Site Crawler View – see text information that see site crawler like GoogleBot or other SE bots. Good for diagnosing websites and to see exact infomation that see site crawler. How do I use this tool? [+] Enter a single URL to check in the form below. Click Continue to get your results.