Submitted by David Hall on Wed, 10/01/2014 - 23:17
Multiple choice question
The Robots.txt file tells search engines (Choose all that apply):
| Which pages to crawl and index on your site | |
| Which pages not to crawl or index on your site | |
| Whether a page should be redirected to the www. version or the non-www. version. | |
| The URL of every page on your site, the priority of each page and how often the page is updated. |
Leave a comment