October 10, 200817 yr Well I was browseing the forum, and I saw this in that ghostly purple: Baidu [spider] So what exactly is a Spider? Is it something like a bot? Clan Moderator from December 15th 2006- August 20th 2007Founder of: Terran Gamers, formerly known as Militos Deci
October 10, 200817 yr Yep. It's a computer that indexes the internet for search engines like Google. On previous versions of phpBB they showed up as guests.
October 10, 200817 yr Author Thanks for the info. I think their really should be a sticky some wheres about Bots Spiders, and any other odd user id tags (or whatever these are called) we have around here. Clan Moderator from December 15th 2006- August 20th 2007Founder of: Terran Gamers, formerly known as Militos Deci
October 10, 200817 yr Thanks for the info. I think their really should be a sticky some wheres about Bots Spiders, and any other odd user id tags (or whatever these are called) we have around here. Here, copypasta from one of my phpBB installations: [hide=bots]AdsBot [Google] Alexa [bot] Alta Vista [bot] Ask Jeeves [bot] Baidu [spider] Exabot [bot] FAST Enterprise [Crawler] FAST WebCrawler [Crawler] Francis [bot] Gigabot [bot] Google Adsense [bot] Google Desktop Google Feedfetcher Google [bot] Heise IT-Markt [Crawler] Heritrix [Crawler] IBM Research [bot] ICCrawler - ICjobs ichiro [Crawler] Majestic-12 [bot] Metager [bot] MSN NewsBlogs MSN [bot] MSNbot Media NG-Search [bot] Nutch [bot] Nutch/CVS [bot] OmniExplorer [bot] Online link [Validator] psbot [Picsearch] Seekport [bot] Sensis [Crawler] SEO Crawler Seoma [Crawler] SEOSearch [Crawler] Snappy [bot] Steeler [Crawler] Synoo [bot] Telekom [bot] TurnitinBot [bot] Voyager [bot] W3 [sitesearch] W3C [Linkcheck] W3C [Validator] WiseNut [bot] YaCy [bot] Yahoo MMCrawler [bot] Yahoo Slurp [bot] Yahoo [bot] YahooSeeker [bot][/hide]
October 10, 200817 yr Author Well maybe not a sticky then, but a mention of them some wheres- like in an official topic about the forum. And what are crawlers, validaters, and the others? Clan Moderator from December 15th 2006- August 20th 2007Founder of: Terran Gamers, formerly known as Militos Deci
October 18, 200817 yr Only a few people have actually bothered to mention them. Most people just ignore. If someone was that desperate, they could always do a google search. [software Engineer] - [Ability Bar Suggestion] - [Gaming Enthusiast]
October 18, 200817 yr They could do a search on the forum, and this topic would pop up. Problem solved. :) You're accusing me of bigotry, how ironic. It's a nice attempt at argument, but your responses are facile and asinine, if not diatribe. Who's arrogant now?
October 18, 200817 yr And what are crawlers, validaters, and the others? If you're developing a website and want it to be valid XHTML, you go to the WC3 site and give it the address. It sends a bot (Labeled on phpBB as a validater) to the website to get the XHTML, so that you can validate it. That's the idea with a validator.
Create an account or sign in to comment