How do you explain a spider of a search engine you only want him to index just the first page of your website or he is allowed to index the whole website. You use the so called ROBOTS tag.
The robots meta tag is not the same as the file called robots.txt You should use these two together. Both...