Current Assignment(s)

A5: Multimedia
Due: Recommended by Monday, 5.28

Robots

The robots name type tells browsers whether they may spider or crawl the published webpage.

This name type takes one of four acceptable content values:

  • noindex value - Prevents a page from being indexed.
  • nofollow value - Prevents links from being crawled.
  • noarchive value - Instructs a search engine not to store an archived copy of the page.
  • nosnippet value - Asks that the search engine not include a snippet from the page along with the page’s listing in search results.
HTML
<meta name="robots" content="nofollow">