Web Design

337

CHAPTER

Publishing Your Site and Getting Noticed 14

TIP

Will this absolutely guarantee that those pages will not show up in search?

Unfortunately, there is no way to guarantee that search engines will pay attention to instructions in robots.

txt files. Some search engines will still display a page not indexed in the results, but not provide details

such as descriptions, whereas others may not display it at all. If you have content that you want to be

absolutely certain is not going to appear in search results, you should not place it on the Web.

6 Save the file in your root
folder with a name of
robots.txt.

The page or pages specified
in the text file should now be
ignored by search engines.

5 Repeat Step 4 to add
additional Disallow
statements as needed. 5

6