Posted on

What effect will this line in robots.txt have on Google’s crawling behavior? # Disallow: /

  • It will disallow crawling of every page and resource on the site
  • It will disallow crawling of the home page only
  • It will allow crawling of the home page only
  • It will not have any effect on crawling