How to keep Google from crawling pages in a directory, subdomain or addon domain

In Windows, open the program Notepad and add the following text:

User-agent: *
Disallow: /

Next save the file as robot.txt then use an FTP program to upload the file to the directory/subdomain/addon domain you want Google to avoid indexing.

Leave a Comment

Your email address will not be published. Required fields are marked *