exalead

Home > Can Exalead index your website?

Can Exalead index your website?

You can control the access indexing machines like our webcrawler 'Exabot' have to your website using a robots.txt file in the root directory of your website and/or by using a robots meta tag on your pages. You can check here whether our webcrawler can index a specific URL on your website or not. For more information on formatting a robots.txt file and the robots meta tag, check The Robots Pages or our Webmaster's guide.


Required Field