Posted on

Which of the following is NOT a function of the robots.txt file?

  • Show search engine bots all the pages on a site
  • Prevent search engines from crawling private pages
  • Keep search engine bots from overwhelming server resources
  • Specify the location of your sitemap