How to earn money from
your blog or website using Google AdSense.
How to control
the AdSense Google Bot
As soon as you place AdSense adverts into your
web pages, Google will send out its little AdSense bot to
determine what your web page content is. It can then determine
what adverts to place on your web page (note: did you know
that your website is visited several times a second by little
bots from different search engines all analyzing your website
content!).
The good thing is that the Google bot behaves itself and
follows the rules that are considered good practice. This
means that you can control which pages you want the bot
to look at and which pages you do not.
In order to control the bot you need to make sure that
there is a file called robots.txt in your home directory.
If there isn't one then create one (leave it empty).
Example A:
Lets say you don't want the AdSense bot to look at the web
pages in a directory called /myproducts
Solution: Add the following two lines to robots.txt:
User-agent: Mediapartners-Google
Disallow: /myproducts/
Example B:
Lets say you don't want the AdSense bot to look at a web page call /my_product_list.html
Solution: Add the following two lines to robots.txt:
User-agent: Mediapartners-Google
Disallow: /my_product_list.html
Related Links:
| 
