Search Engine[Bots] in the Forums
Posted:
Wed Dec 09, 2015 9:28 amby janitorialduties
So in the "Users using this Forum" I occasionally see Google[bot], Yahoo[Bot], and Bing[Bot]. What are they? Do they search through the forum to add to their search que, like searching for key words and what not?
Re: Search Engine[Bots] in the Forums
Posted:
Wed Dec 09, 2015 11:20 amby stefan
I believe so. They're crawling websites for content, so they can index them for their search results.
Re: Search Engine[Bots] in the Forums
Posted:
Wed Dec 09, 2015 11:49 amby janitorialduties
stefan wrote:I believe so. They're crawling websites for content, so they can index them for their search results.
Excellent! I thought as much! Still a little spooky seeing their presence.
Re: Search Engine[Bots] in the Forums
Posted:
Wed Dec 09, 2015 12:16 pmby tw2000
So what is the Baidu[spider] doing?
Re: Search Engine[Bots] in the Forums
Posted:
Wed Dec 09, 2015 1:31 pmby pandasecret
tw2000 wrote:So what is the Baidu[spider] doing?
Baidu is the Chinese search engine (Google is banned in China).
For what the [text] means, here is a handy post:
http://www.webdeveloper.com/forum/showt ... and-robots