Submitted by David Hall on Wed, 11/05/2014 - 09:53
Multiple choice question
What function does a robots.txt file serve?
| a. It lists all of the pages on your website so that search engines are able to crawl and index the entire site. | |
| b. It automatically submits your website to search engines. | |
| c. It provides instructions to search engines about what pages should and should not be crawled. | |
| d. It allows you to set up rewrite rules that automatically affect the URL structure of your webpages. |
Leave a comment