I was just looking at the "Who's Online" list, and at the bottom, after it showed what the Guests' were doing, it showed "Spiders." 2 Yahoo Spiders and a Google Spider.
So what are these "Spiders"?
Spiders are things sites like Google use to crawl the web, they archive things, and what not, as well as help determine your ranking on their respective sites.
Quote from: mackormoses on June 27, 2008, 12:38:11 AM
Spiders are things sites like Google use to crawl the web, they archive things, and what not, as well as help determine your ranking on their respective sites.
..?
So some computer thing is crawling around the site and deciding where to put the site on the list if you type something on their search bar?
Quote from: JrDude on June 27, 2008, 12:41:02 AM
Quote from: mackormoses on June 27, 2008, 12:38:11 AM
Spiders are things sites like Google use to crawl the web, they archive things, and what not, as well as help determine your ranking on their respective sites.
..?
So some computer thing is crawling around the site and deciding where to put the site on the list if you type something on their search bar?
That is one of many features. It archives, that is what it does.
Here, this (http://en.wikipedia.org/wiki/Web_crawler) may help.
Quote from: mackormoses on June 27, 2008, 12:45:37 AM
Quote from: JrDude on June 27, 2008, 12:41:02 AM
Quote from: mackormoses on June 27, 2008, 12:38:11 AM
Spiders are things sites like Google use to crawl the web, they archive things, and what not, as well as help determine your ranking on their respective sites.
..?
So some computer thing is crawling around the site and deciding where to put the site on the list if you type something on their search bar?
That is one of many features. It archives, that is what it does.
Here, this (http://en.wikipedia.org/wiki/Web_crawler) may help.
Awsome, thanks.