What is a web spider?
A web spider (crawl the web) is a software program often used by search engines to locate websites for inclusion in a
particular search engine.
It is also called a "bot."
The search engines extract information from websites such as the title of the pages and the keywords. They can tell when
the website was last modified. All of this information is transmitted to the central system deposit for indexing.
The spider will find all the links on your site that lead to other sites and creat "backlinks" to those sites. These are very
valuable to have for your website. Google trusts you more if you have a lot of good, pertinent incoming links.
It is important to understand how spiders affect your website. This information will help you do your SEO jobs.
The Mighty Mo Website Design and SEO