Google Bots and What They Mean For SEO
Sunday, September 27, 2009 Posted by !ndra
Google Bot Current version: Googlebot 2.1
A google bot works as a search bot; or, a search engine that uses web crawling bots to collect information from all over the web to construct a searchable index. These bot's work by searching the web and then reporting the information to all of googles services. Other terms are web crawlers, ants, automatic indexers, bots and worms or web robot.
MSNbot, and yahoo slurp are the same thing as googlebots but they provide information exclusivly to there own web pages.
OK, this part may be a tad confusing but make sure you have read all articles regarding seo so it all makes perfect sense.
if you have access to your html you will be able to toggle with your google bot settings
To Allow Googlebot
User-agent: Googlebot
Allow: / (or list a directory or page that you want to allow)
To Block Googlebot
User-agent: Googlebot
Disallow: / (or list a directory or page that you want to disallow)
Pros and Cons of Googlebot
- It only follows HREFlinks and SRC links
- It can quickly build a list of links that come from the web
- It takes up a large amount of bandwidth
- Some pages take longer to find, so crawling may occur once a month vice daily
- It must be setup/programmed to function properly
- It recrawls popular frequently-changing web pages to keep the index current
I hope this has been helpful for your seo efforts, visit the link below for more information for your home business.
0 comments:
Post a Comment