Meta Robots Tag

Seo Tip 23    Meta Robots Tag

Syntax: < META name="Robots" content="INDEX,FOLLOW">

The robots instructions are normally placed in a robots.txt file that is uploaded to the root directory of a domain. However, if a webmaster does not have access to /robots.txt, then instructions can be placed in the Robots META tag. This tag tells the search engine robots whether a page should be indexed and included in the search engine database and its links followed.

The content of the robots meta tag is a comma separated list that may contain the following commands:

ALL also INDEX,FOLLOW -- there are no restrictions on indexing the page or following links; NONE also NOINDEX,NOFOLLOW -- robots must ignore the page; a combination of INDEX, FOLLOW, NOINDEX, NOFOLLOW -- if you want a search engine robot just to index a page but not to follow links, you should specify 'INDEX,NOFOLLOW', if you want it to follow links without indexing the page, you should instruct robots as 'NOINDEX,FOLLOW'.

The purpose of the check done by Web CEO is to ensure there are no commands that might prevent search engine robots from indexing a page and following links. For that reason, 'ALL' or 'INDEX, FOLLOW' are commands expected in this tag.

Disclaimer   We hope that you found the Seo tip number 23 - Meta Robots Tag      Back to Index Page