Results of Tests for <object> loading behavior

TestNo requestHEADGET
Object with type set to invalid type
(no request expected)
  • 9090
  • ActiveBookmark 1.x
  • agentname/Nutch-1.0-dev
  • AppEngine-Google; (+http://code.google.com/appengine; appid: freesurf003)
  • AppEngine-Google; (+http://code.google.com/appengine; appid: g-proxy)
  • AppEngine-Google; (+http://code.google.com/appengine; appid: mqbrokeraccess)
  • AppEngine-Google; (+http://code.google.com/appengine; appid: s~vulture-engine)
  • Baiduspider+(+http://www.baidu.com/search/spider.htm)
  • BlackBerry8520/4.6.1.195 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/100
  • BlackBerry8520/4.6.1.227 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/100
  • BlackBerry8900/5.0.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/-1
  • BlackBerry9700/5.0.0 Profile/MIDP-2.1 Configuration/CLDC-1.1 VendorID/179
  • CCBot/1.0 (+http://www.commoncrawl.org/bot.html)
  • Crawler0.1
  • DoCoMo/1.0/N505i/c20/TB/W20H10 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
  • DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
  • DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo; +http://help.goo.ne.jp/help/article/1142/)
  • FAST Enterprise Crawler/6.7.0 (crawler@fast.no)
  • Gaisbot/3.0+(robot06@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot.php)
  • Gigabot/3.0 (http://www.gigablast.com/spider.html)
  • Goldfire Server
  • GurujiBot/1.0 (+http://www.guruji.com/en/WebmasterFAQ.html)
  • HablaCentro/1.0 (HablaCentro Crawler; http://hablacentro.com/; webmaster@hablacentro.com)
  • HD nutch agent/1.0
  • HTC-diamond
  • http://mycompany.com/es/crawler
  • HUAWEI-M328/001.00 ACS-NetFront/3.2
  • ia_archiver
  • ia_archiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com)
  • ICC-Crawler/2.0 (Mozilla-compatible; ; http://kc.nict.go.jp/project1/crawl.html)
  • ichiro/3.0 (http://help.goo.ne.jp/door/crawler.html)
  • Internet Explorer
  • Internet Explorer 8.0
  • Isidorus/2.0 (Isidorus; http://www.isidorus.com; crawler@isidorus.com)
  • Iudhak lhdmxiwr jzsbdrl
  • Java/1.6.0_0
  • Keybot Translation-Search-Machine
  • larbin_2.6.3 m.p.griffiths@cranfield.ac.uk
  • librabot/1.0 (+http://search.msn.com/msnbot.htm)
  • librabot/2.0 (+http://academic.research.microsoft.com/)
  • librabot/2.0/1.0 (+http://search.msn.com/msnbot.htm)
  • Mail.Ru/1.0
  • Mozilla
  • Mozilla/2.0 (compatible; MSIE 4.0; Windows 98)
  • Mozilla/4.0
  • Mozilla/4.0 (compatible; ICS)
  • Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 5.0 Robot)
  • Mozilla/4.0 (compatible; MSIE 5.0; Windows 98)
  • Mozilla/4.0 (compatible; MSIE 5.0; Windows NT 4.0)
  • Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt)
  • Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt; DTS Agent
  • Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0)
  • Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) Fetch API Request
  • Mozilla/4.0 (compatible; MSIE 6.0)
  • Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)
  • Mozilla/4.0 (compatible; MSIE 6.0; Windows CE; IEMobile 8.12; MSIEMobile 6.0) T-Mobile_Maple
  • Mozilla/4.0 (compatible; MSIE 6.0; Windows CE; IEMobile 8.12; MSIEMobile 6.0) T-Mobile_Rhodium
  • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0)
  • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; Google Wireless Transcoder;)
  • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
  • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
  • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)
  • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; InfoPath.1)
  • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; InfoPath.1)
  • Mozilla/4.0 (Compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727; .NET CLR 1.1.4322)
  • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648; InfoPath.1)
  • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727; InfoPath.1; MS-RTC LM 8)
  • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; GTB5; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648)
  • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; i-NavFourF; (R1 1.6); .NET CLR 1.1.4322; InfoPath.1; .NET CLR 2.0.50727)
  • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Maxthon; .NET CLR 1.0.3705; .NET CLR 2.0.50727; .NET CLR 1.1.4322; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)
  • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Maxthon; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 1.0.3705; .NET CLR 1.1.4322)
  • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; xs-nwo59GiQ0mE; .NET CLR 2.0.50727; .NET CLR 1.1.4322)
  • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.2; MyIE2; .NET CLR 1.1.4322)
  • Mozilla/4.0 (compatible; MSIE 6.1; Windows XP)
  • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322)
  • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727)
  • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727)
  • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022)
  • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)
  • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; InfoPath.1; .NET CLR 3.0.04506.30; MS-RTC LM 8)
  • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; InfoPath.2)
  • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; ABCPlayer_1.3.19; ITVPlayer_1.3.22; .NET CLR 2.0.50727; .NET CLR 1.1.4322; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022; InfoPath.2)
  • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; InfoPath.1; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30)
  • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; Mobivillage; .NET CLR 1.1.4322; .NET CLR 2.0.50727; Mobivillage; Mobivillage)
  • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)
  • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; SV1)
  • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)
  • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; Trident/4.0; GTB5; FBSMTWB; .NET CLR 1.0.3705; .NET CLR 1.1.4322; .NET CLR 2.0.50727; Windows-Media-Player/10.00.00.3990; SpamBlockerUtility 10.2.203.0; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729; Media C
  • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; WOW64; InfoPath.1)
  • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0)
  • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; SIMBAR={2B1EFD74-D728-11DC-AC1A-001B24ECDF5D}; SLCC1; .NET CLR 2.0.50727; Media Center PC 5.0; .NET CLR 3.0.04506)
  • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; SLCC1; .NET CLR 2.0.50727; .NET CLR 1.1.4322; .NET CLR 3.5.21022; .NET CLR 3.5.30729; .NET CLR 3.0.30729; OfficeLiveConnector.1.4; OfficeLivePatch.1.3; Creative AutoUpdate v1.10.10)
  • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; WOW64; Trident/4.0; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; SLCC1; .NET CLR 2.0.50727; Media Center PC 5.0; InfoPath.2; .NET CLR 1.1.4322; .NET CLR 3.5.30729; .NET CLR 3.0.30618)
  • Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 1.0.3705; InfoPath.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; MS-RTC LM 8)
  • Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 1.1.4322)
  • Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727; InfoPath.1; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)
  • Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)
  • Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; GTB7.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729; .NET4.0C; .NET4.0E; OfficeLiveConnector.1.3; OfficeLivePatch.0.0)
  • Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; InfoPath.2; .NET CLR 2.0.50727; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)
  • Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; Media Center PC 5.0; SLCC1)
  • Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; WOW64; Trident/4.0; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; InfoPath.2)
  • Mozilla/4.0 (compatible; Virtuoso)
  • Mozilla/4.0 (compatible;)
  • Mozilla/4.0 (PSP (PlayStation Portable); 2.00)
  • Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)
  • Mozilla/4.5 (compatible; MSIE 6.0; Windows 98)
  • Mozilla/4.77C-SGI [en] (X11; U; IRIX 6.5 IP32)
  • Mozilla/5.0 (BREW; U; 3.1.5; en) AppleWebKit/528.28 (KHTML, like Gecko) OBIGO/W10.1 Safari/528.5 480X800 LGE VX11000
  • Mozilla/5.0 (compatible; AhrefsBot/2.0; +http://ahrefs.com/robot/)
  • Mozilla/5.0 (compatible; AportWorm/3.2; +http://www.aport.ru/help)
  • Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml)
  • Mozilla/5.0 (compatible; AutomaticSiteMap)
  • Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
  • Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
  • Mozilla/5.0 (compatible; Charlotte/1.1; http://www.searchme.com/support/)
  • Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html)
  • Mozilla/5.0 (compatible; discobot/1.1; +http://discoveryengine.com/discobot.html)
  • Mozilla/5.0 (compatible; DotBot/1.1; http://www.dotnetdotcom.org/, crawler@dotnetdotcom.org)
  • Mozilla/5.0 (compatible; Exabot/3.0 (BiggerBetter); +http://www.exabot.com/go/robot)
  • Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)
  • Mozilla/5.0 (compatible; Ezooms/1.0; ezooms.bot@gmail.com)
  • Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
  • Mozilla/5.0 (compatible; GurujiBot/1.0; +http://www.guruji.com/en/WebmasterFAQ.html)
  • Mozilla/5.0 (compatible; mobilizer; +http://www.mobilizer.com)
  • Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server; +http://ws.daum.net/aboutWebSearch.html) Daumoa/2.0
  • Mozilla/5.0 (compatible; Reflectbot/1.0; +http://re.flect.net) AppEngine-Google; (+http://code.google.com/appengine; appid: reflectnet)
  • Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/)
  • Mozilla/5.0 (compatible; Steeler/3.4; http://www.tkl.iis.u-tokyo.ac.jp/~crawler/)
  • Mozilla/5.0 (compatible; SuchbaerBot/0.83; +http://bot.suchbaer.de/info.html)
  • Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
  • Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
  • Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
  • Mozilla/5.0 (en-us) AppleWebKit/525.13 (KHTML, like Gecko; Google Web Preview) Version/3.1 Safari/525.13
  • Mozilla/5.0 (iPhone; U; CPU iPhone OS 3_1_2 like Mac OS X; ko-kr) AppleWebKit/528.18 (KHTML, like Gecko) Version/4.0 Mobile/7D11 Safari/528.16
  • Mozilla/5.0 (Linux; U; Android 0.5; en-us) AppleWebKit/522+ (KHTML, like Gecko) Safari/419.3
  • Mozilla/5.0 (Linux; U; Android 1.0; en-us; generic) AppleWebKit/525.10+ (KHTML, like Gecko) Version/3.0.4 Mobile Safari/523.12.2
  • Mozilla/5.0 (Linux; U; Android 2.3.3; ja-jp; sdk Build/GRI34) AppleWebKit/528.4 (KHTML, like Gecko) Safari/1.0
  • Mozilla/5.0 (Linux; U; Android 2.3.3; ja-jp; sdk Build/GRI34) AppleWebKit/533.1 (KHTML, like Gecko) TmmBrowser/1.0
  • Mozilla/5.0 (Macintosh; U; Intel Mac OS X; sv-SE; rv:1.8.1.13) Gecko/20080311 Firefox/2.0.0.13
  • Mozilla/5.0 (SymbianOS/9.1; U; en-us) AppleWebKit/413 (KHTML, like Gecko) Safari/413
  • Mozilla/5.0 (SymbianOS/9.1; U; en-us) AppleWebKit/413 (KHTML, like Gecko) Safari/413 es65
  • Mozilla/5.0 (SymbianOS/9.2; U; Series60/3.1 NokiaN95/11.0.026; Profile/MIDP-2.0 Configuration/CLDC-1.1 ) AppleWebKit/413 (KHTML, like Gecko) Safari/413
  • Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html)
  • Mozilla/5.0 (Windows NT 5.1) AppleWebKit/534.30 (KHTML, like Gecko) Chrome/12.0.742.112 Safari/534.30
  • Mozilla/5.0 (Windows NT 5.1) AppleWebKit/534.30 (KHTML, like Gecko) Chrome/12.0.742.122 Safari/534.30
  • Mozilla/5.0 (Windows NT 5.1) AppleWebKit/535.1 (KHTML, like Gecko) Chrome/13.0.782.99 Safari/535.1
  • Mozilla/5.0 (Windows NT 5.1) AppleWebKit/535.2 (KHTML, like Gecko) Chrome/15.0.874.106 Safari/535.2
  • Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/535.1 (KHTML, like Gecko) Chrome/13.0.782.107 Safari/535.1
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; da; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/525.19 (KHTML, like Gecko) Chrome/1.0.154.36 Safari/525.19
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/528+ (KHTML, like Gecko) Version/3.1.2 Safari/525.21
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/530.5 (KHTML, like Gecko) Chrome/2.0.172.6 Safari/530.5
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/532.0 (KHTML, like Gecko) Chrome/3.0.195.27 Safari/532.0
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/532.5 (KHTML, like Gecko) Chrome/4.1.249.1064 Safari/532.5
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/534.16 (KHTML, like Gecko) Chrome/10.0.648.204 Safari/534.16
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/534.16 (KHTML, like Gecko) Chrome/10.0.648.205 Safari/534.16
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/534.7 (KHTML, like Gecko) Chrome/7.0.517.41 Safari/534.7
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/)
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.16) Gecko/20080702 Firefox/2.0.0.16
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.16) Gecko/20080714 Firefox/2.0.0.16 Flock/1.2.4
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.20) Gecko/20081217 Firefox/2.0.0.20
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.8) Gecko/2009032609 Firefox/3.0.8
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; es-ES; rv:1.8) Gecko/20060321 Firefox/2.0a1
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.9.2.13) Gecko/20101203 Firefox/3.6.13
  • Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10 (.NET CLR 3.5.30729)
  • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US) AppleWebKit/532.5 (KHTML, like Gecko) Chrome/4.1.249.1036 Safari/532.5
  • Mozilla/5.0 (X11; I; Linux 2.6.22-gentoo-r8 x86_64) Gecko/20071115 Firefox/2.0.0.10
  • Mozilla/5.0 (X11; U; Linux i686 (x86_64); en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11
  • Mozilla/5.0 (X11; U; Linux i686 (x86_64); en-US; rv:1.8.1.4) Gecko/20080721 BonEcho/2.0.0.4
  • Mozilla/5.0 (X11; U; Linux i686; en-US) AppleWebKit/534.13 (KHTML, like Gecko) Chrome/9.0.597.98 Safari/534.13
  • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:Spinn3r (Spinn3r 3.1); http://spinn3r.com/robot) Gecko/20021130
  • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.7) Gecko/20060909 Firefox/1.5.0.7 MG(Novarra-Vision/6.9)
  • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1) Gecko/20060601 Firefox/2.0 (Ubuntu-edgy)
  • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.14) Gecko/2009090216 Ubuntu/9.04 (jaunty) Firefox/3.0.14
  • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.14) Gecko/2009090216 Ubuntu/9.04 (jaunty) Firefox/3.0.14 (via babelfish.yahoo.com)
  • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1b1pre) Gecko/20080915000512 SeaMonkey/2.0a1pre
  • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1b1pre) Gecko/20080915000512 SeaMonkey/2.0a1pre (via babelfish.yahoo.com)
  • Mozilla/5.0 (X11; U; Linux i686; en; rv:1.8.1.11) Gecko/20071204 Epiphany/2.20 Firefox/2.0.0.11
  • Mozilla/5.0 SixXS-IPv6Gate/3.1 (IPv6 to IPv4 Gateway; http://www.sixxs.net/tools/gateway/; info@sixxs.net) ForwardedFor/2001:da8:2000:2192:230:48ff:fecb:b918 2001:da8:2000:2192:230:48ff:fecb:b918
  • Mozilla/5.0 SixXS-IPv6Gate/3.1 (IPv6 to IPv4 Gateway; http://www.sixxs.net/tools/gateway/; info@sixxs.net) ForwardedFor/2001:da8:2000:2192::510 2001:da8:2000:2192::510
  • Mozilla/5.0 SixXS-IPv6Gate/3.1 (IPv6 to IPv4 Gateway; http://www.sixxs.net/tools/gateway/; info@sixxs.net) ForwardedFor/2001:da8:2000:2192::620 2001:da8:2000:2192::620
  • msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)
  • msnbot/1.0 (+http://search.msn.com/msnbot.htm)
  • msnbot/1.1 (+http://search.msn.com/msnbot.htm)
  • msnbot/2.0b
  • msnbot/2.0b (+http://search.msn.com/msnbot.htm)
  • msnbot/2.0b (+http://search.msn.com/msnbot.htm).
  • msnbot/2.0b (+http://search.msn.com/msnbot.htm)._
  • MSNBOT_Mobile MSMOBOT Mozilla/2.0 (compatible; MSIE 4.02; Windows CE; Default)/1.1 (+http://search.msn.com/msnbot.htm)
  • MSRBOT (http://research.microsoft.com/research/sv/msrbot/)
  • NG/2.0
  • Nokia3108/1.0 (05.08) Profile/MIDP-1.0 Configuration/CLDC-1.0
  • Nokia6820/2.0 (4.83) Profile/MIDP-1.0 Configuration/CLDC-1.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
  • nu_tch-princeton/Nu_tch-1.0-dev (princeton crawler for cass project; http://www.cs.princeton.edu/cass/; zhewang a_t cs ddot princeton dot edu)
  • Opera/9.23 (Windows NT 5.1; U; en)
  • Opera/9.52 (Windows NT 5.1; U; en)
  • Opera/9.62 (Windows NT 5.1; U; en)
  • Opera/9.64 (Windows NT 5.1; U; en)
  • Opera/9.80 (Windows NT 5.1; U; en) Presto/2.2.15 Version/10.10
  • Opera/9.80 (Windows NT 5.1; U; en) Presto/2.6.30 Version/10.62
  • porn_viewer larbin2.6.3@unspecified.mail
  • psbot/0.1 (+http://www.picsearch.com/bot.html)
  • psnsearch
  • Python-urllib/1.16
  • SAMSUNG-S8000/1.0 SHP/VPP/R5 Jasmine/1.0 Nextreaming SMM-MMS/1.2.0 profile/MIDP-2.1 configuration/CLDC-1.1
  • SAMSUNG-S8000/S8000XXHC1 SHP/VPP/R5 Jasmine/1.0 Nextreaming SMM-MMS/1.2.0 profile/MIDP-2.1 configuration/CLDC-1.1 SS-Widget/S8000-FM
  • SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
  • SAMSUNG-SGH-T239/T239UVIA4 NetFront/3.4 Profile/MIDP-2.0 Configuration/CLDC-1.1
  • SAP-KM/WebRepository 1.2
  • schnuffie/Nutch-1.0 (just a test)
  • SD Crawler/Nutch-0.9 (automated Crawler)
  • search crawler/Nutch-1.3-dev (crawl bot for the searcher)
  • Seekbot/1.0 (http://www.seekbot.net/bot.html) HTTPFetcher/2.2
  • SonyEricssonCS8/R1DA Browser/NetFront/3.4 Profile/MIDP-2.1 Configuration/CLDC-1.1 JavaPlatform/JP-8.4.1
  • SonyEricssonK800i/R1JG Browser/NetFront/3.3 Profile/MIDP-2.0 Configuration/CLDC-1.1
  • swanbot
  • Teleport Pro/1.59
  • Teoma/Nutch-1.0 ( Question and Answer Search; afarm.com; bot@afarm.com)
  • Teoma/Nutch-1.0 ( Question and Answer Search; bot@afarm.com)
  • TestBot 1.0
  • W3C_Validator/1.581
  • WebCopier v5.0
  • Webcrawler/Nutch-1.0-dev (Test crawl; lucene.apache.org/nutch/; a@b.net)
  • webmeasurement-bot/Nutch-1.2 (http://rvs.informatik.uni-leipzig.de/bot.php)
  • Wget/1.10.2
  • Wget/1.10.2 (Red Hat modified)
  • Wget/1.11.1 (Red Hat modified)
  • Wget/1.11.3
  • Wget/1.11.4
  • Wget/1.11.4 Red Hat modified
  • Wget/1.12 (darwin10.2.0)
  • Wget/1.12 (linux-gnu)
  • Wget/1.12-devel
  • Wget/1.8.2
  • Wget/1.9+cvs-dev-200312170931
  • Wget/1.9+cvs-stable (Red Hat modified)
  • Wget/1.9.1
  • Yandex/1.01.001 (compatible; Win16; I)
  • YandexSomething/1.0
  • Yanga WorldSearch Bot v1.1/beta (http://www.yanga.co.uk/)
  • ZanranCrawler/0.2 (helpdesk@zanran.com)
  • NokiaN73-1/3.0704.1.0.1 Series60/3.0 Profile/MIDP-2.0 Configuration/CLDC-1.1
  • Wget/1.12 (linux-gnu)
  • Arquivo-web-crawler (compatible; heritrix/1.14.3 +http://arquivo.pt/faq-crawling)
  • BlackBerry8703e/4.1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/105
  • LGE-LG290C/1.0[TF268435458513872793000000014176699802] UP.Browser/6.2.3.8 (GUI) MMP/2.0
  • MOT-A-B7/01.00 UP.Browser/7.2.7.2.520 (GUI) MMP/2.0 Push/PO UP.Link/5.1.2.17
  • Mozilla
  • Mozilla/4.0 (compatible; MSIE 5.0; Windows NT 4.0)
  • Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; PalmSource/hspr-H102; Blazer/4.2) 16;320x320
  • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) Opera 8.65 [en]
  • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)
  • Mozilla/4.1 (compatible; Symbian OS; Series 60) Teleca/Q7.0
  • Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)
  • Mozilla/5.0 (BREW; U; 3.1.5; en) AppleWebKit/528.28 (KHTML, like Gecko) OBIGO/W10.0 Safari/528.5 480X800 LGE VX11000
  • Mozilla/5.0 (compatible; heritrix/1.14.0 +http://www.fscals.com)
  • Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; WOW64; Trident/5.0)
  • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.0.7) Gecko/2009021906 Firefox/3.0.7
  • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1.1) Gecko/20090715 Firefox/3.5.1
  • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.12) Gecko/20101026 Firefox/3.6.12
  • Mozilla/5.0 (SymbianOS/9.2; U; Series60/3.1 NokiaN95/11.0.026; Profile/MIDP-2.0 Configuration/CLDC-1.1 ) AppleWebKit/413 (KHTML, like Gecko) Safari/413
  • Mozilla/5.0 (Windows NT 5.1; rv:2.0.1) Gecko/20100101 Firefox/4.0.1
  • Mozilla/5.0 (Windows NT 5.1; rv:2.0b9) Gecko/20100101 Firefox/4.0b9
  • Mozilla/5.0 (Windows NT 6.1; WOW64; rv:10.0) Gecko/20100101 Firefox/10.0
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.2) Gecko/2008091620 Firefox/3.0.2 (.NET CLR 3.5.30729)
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.5) Gecko/2008120122 Firefox/3.0.5 (.NET CLR 3.5.30729)
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.1.2) Gecko/20090729 Firefox/3.5.2 (.NET CLR 3.5.30729)
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10 (.NET CLR 3.5.30729)
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.12) Gecko/2009070611 Firefox/3.0.12
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.15) Gecko/2009101601 Firefox/3.0.15 (.NET CLR 3.5.30729)
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.4) Gecko/2008102920 Firefox/3.0.4
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.5) Gecko/2008120122 Firefox/3.0.5
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.6) Gecko/2009011913 Firefox/3.0.6
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.8) Gecko/2009032609 Firefox/3.0.8
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.9) Gecko/2009040821 Firefox/3.0.9 (.NET CLR 3.5.30729)
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.2) Gecko/20090729 Firefox/3.5.2
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.10) Gecko/20100914 Firefox/3.6.10 ( .NET CLR 3.5.30729)
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en; like Gecko) Obigo/Q7
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; es-ES; rv:1.9.0.6) Gecko/2009011913 Firefox/3.0.6
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; es-ES; rv:1.9.0.8) Gecko/2009032609 Firefox/3.0.8
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.9.1.7) Gecko/20091221 Firefox/3.5.7
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.9.1.7) Gecko/20091221 Firefox/3.5.7 (.NET CLR 3.5.30729)
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.9.2) Gecko/20100115 Firefox/3.6 ( .NET CLR 3.5.30729; .NET4.0E)
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.9.2.12) Gecko/20101026 Firefox/3.6.12 ( .NET CLR 3.5.30729)
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; ko; rv:1.9.0.7) Gecko/2009021910 Firefox/3.0.7
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; ko; rv:1.9.2.16) Gecko/20110319 Firefox/3.6.16 (.NET CLR 3.5.30729)
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-TW; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1
  • Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.9.0.5pre) Gecko/2008120105 GranParadiso/3.0.5pre (.NET CLR 3.5.30729)
  • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.5) Gecko/2008120122 Firefox/3.0.5
  • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.6) Gecko/2009011913 Firefox/3.0.6
  • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1b4pre) Gecko/20090409 Shiretoko/3.5b4pre (.NET CLR 3.5.30729)
  • Mozilla/5.0 (Windows; U; Windows NT 6.0; it; rv:1.9.1.7) Gecko/20091221 Firefox/3.5.7 (.NET CLR 3.5.30729)
  • Mozilla/5.0 (X11; U; Linux i686; de; rv:1.9.0.3) Gecko/2008092510 Ubuntu/8.04 (hardy) Firefox/3.0.3 FirePHP/0.1.2
  • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.7) Gecko/20060909 Firefox/1.5.0.7 MG(Novarra-Vision/6.9)
  • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9) Gecko/2008060309 Firefox/3.0
  • Opera/9.24 (X11; Linux i686; U; en)
  • Opera/9.50 (J2ME/MIDP; Opera Mini/4.0.9751/230; U; fr)
  • Opera/9.50 (J2ME/MIDP; Opera Mini/4.0.9800/230; U; en)
  • Opera/9.50 (Windows NT 5.1; U; en)
  • Opera/9.60 (J2ME/MIDP; Opera Mini/4.0.8462/670; U; en) Presto/2.2.0
  • Opera/9.64 (Windows NT 5.1; U; zh-tw) Presto/2.1.1
  • Opera/9.80 (J2ME/MIDP; Opera Mini/4.1.15082/26.1407; U; en) Presto/2.8.119 Version/10.54
  • Opera/9.80 (J2ME/MIDP; Opera Mini/4.3.25172/25.677; U; en) Presto/2.5.25 Version/10.54
  • Opera/9.80 (J2ME/MIDP; Opera Mini/4.4.28000/26.1411; U; en) Presto/2.8.119 Version/10.54
  • Opera/9.80 (Windows NT 5.1; U; en) Presto/2.6.30 Version/10.63
  • Opera/9.80 (Windows NT 5.1; U; ko) Presto/2.2.15 Version/10.10
  • Opera/9.80 (Windows NT 5.1; U; ko) Presto/2.5.24 Version/10.53
  • Opera/9.80 (Windows NT 5.1; U; ko) Presto/2.6.30 Version/10.63
  • Opera/9.80 (Windows NT 5.1; U; ko) Presto/2.8.131 Version/11.11
  • Opera/9.80 (Windows NT 5.1; U; ko) Presto/2.9.168 Version/11.50
  • Opera/9.80 (Windows NT 5.1; U; zh-tw) Presto/2.9.168 Version/11.50
  • SAMSUNG-GT-M8800/M8800XXHIA SHP/VPP/R5 NetFront/3.5 Qtv5.3 SMM-MMS/1.2.0 profile/MIDP-2.1 configuration/CLDC-1.1
  • SAMSUNG-SGH-T349/T349UVIB3 NetFront/3.5 Profile/MIDP-2.0 Configuration/CLDC-1.1
  • SAMSUNG-SGH-T749/T749UVIC6 SHP/VPP/R5 NetFront/3.5 SMM-MMS/1.2.0 profile/MIDP-2.1 configuration/CLDC-1.1
  • SAMSUNG-SGH-T749/T749UVIF3 SHP/VPP/R5 NetFront/3.5 SMM-MMS/1.2.0 profile/MIDP-2.1 configuration/CLDC-1.1
  • Wget/1.10.2
  • Wget/1.10.2 (Red Hat modified)
  • Wget/1.11.3
  • Wget/1.11.4
  • Wget/1.11.4 Red Hat modified
  • Wget/1.12 (linux-gnu)
  • Yanga WorldSearch Bot v1.1/beta (http://www.yanga.co.uk/)
  • zibber-v0.1(www.zibb.com/crawler/)
Object with no type set, invalid content-type
  • (HEAD optimal?)
    • AppEngine-Google; (+http://code.google.com/appengine; appid: freesurf003)
    • AppEngine-Google; (+http://code.google.com/appengine; appid: g-proxy)
    • AppEngine-Google; (+http://code.google.com/appengine; appid: mqbrokeraccess)
    • Baiduspider+(+http://www.baidu.com/search/spider.htm)
    • BlackBerry8520/4.6.1.195 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/100
    • BlackBerry8520/4.6.1.227 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/100
    • BlackBerry8703e/4.1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/105
    • BlackBerry8900/5.0.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/-1
    • BlackBerry9700/5.0.0 Profile/MIDP-2.1 Configuration/CLDC-1.1 VendorID/179
    • CCBot/1.0 (+http://www.commoncrawl.org/bot.html)
    • Crawler0.1
    • DoCoMo/1.0/N505i/c20/TB/W20H10 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
    • DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
    • DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo; +http://help.goo.ne.jp/help/article/1142/)
    • FAST Enterprise Crawler/6.7.0 (crawler@fast.no)
    • Gaisbot/3.0+(robot06@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot.php)
    • Gigabot/3.0 (http://www.gigablast.com/spider.html)
    • Goldfire Server
    • gosospider Mozilla/5.0 (compatible; GosoSpider; +http://www.goso.cn/aboutus.html)
    • gsa-crawler (Enterprise; S5-MPGS7LJ5TGSAB; ewk@uakron.edu)
    • GurujiBot/1.0 (+http://www.guruji.com/en/WebmasterFAQ.html)
    • HablaCentro/1.0 (HablaCentro Crawler; http://hablacentro.com/; webmaster@hablacentro.com)
    • HD nutch agent/1.0
    • http://mycompany.com/es/crawler
    • ia_archiver
    • ia_archiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com)
    • ICC-Crawler/2.0 (Mozilla-compatible; ; http://kc.nict.go.jp/project1/crawl.html)
    • ichiro/3.0 (http://help.goo.ne.jp/door/crawler.html)
    • Internet Explorer
    • Internet Explorer 8.0
    • Isidorus/2.0 (Isidorus; http://www.isidorus.com; crawler@isidorus.com)
    • Java/1.6.0_0
    • Keybot Translation-Search-Machine
    • larbin_2.6.3 m.p.griffiths@cranfield.ac.uk
    • librabot/2.0 (+http://academic.research.microsoft.com/)
    • librabot/2.0/1.0 (+http://search.msn.com/msnbot.htm)
    • loalasam (loalasam@263.com)
    • Mail.Ru/1.0
    • Mozilla
    • Mozilla/2.0 (compatible; MSIE 4.0; Windows 98)
    • Mozilla/3.0(DDIPOCKET;KYOCERA/AH-K3001V/1.8.3.72.000000/0.1/C100) Opera 7.0
    • Mozilla/3.04 (compatible; ANTFresco/2.13; RISC OS 4.02)
    • Mozilla/4.0
    • Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 5.0 Robot)
    • Mozilla/4.0 (compatible; MSIE 5.0; Windows 98)
    • Mozilla/4.0 (compatible; MSIE 5.0; Windows NT 4.0)
    • Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt)
    • Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt; DTS Agent
    • Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0)
    • Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) Fetch API Request
    • Mozilla/4.0 (compatible; MSIE 6.0)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows CE; IEMobile 8.12; MSIEMobile 6.0) T-Mobile_Maple
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows CE; IEMobile 8.12; MSIEMobile 6.0) T-Mobile_Rhodium
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; InfoPath.1)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; InfoPath.1)
    • Mozilla/4.0 (Compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727; .NET CLR 1.1.4322)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648; InfoPath.1)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; GTB5; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Maxthon; .NET CLR 1.0.3705; .NET CLR 2.0.50727; .NET CLR 1.1.4322; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Maxthon; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 1.0.3705; .NET CLR 1.1.4322)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; xs-nwo59GiQ0mE; .NET CLR 2.0.50727; .NET CLR 1.1.4322)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; InfoPath.1; .NET CLR 3.0.04506.30; MS-RTC LM 8)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; ABCPlayer_1.3.19; ITVPlayer_1.3.22; .NET CLR 2.0.50727; .NET CLR 1.1.4322; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022; InfoPath.2)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; GTB5; .NET CLR 2.0.50727; InfoPath.2; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; Mobivillage; .NET CLR 1.1.4322; .NET CLR 2.0.50727; Mobivillage; Mobivillage)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; SV1)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; Trident/4.0; GTB6.5; BTRS28059; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; WOW64; Trident/4.0; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; SLCC1; .NET CLR 2.0.50727; Media Center PC 5.0; InfoPath.2; .NET CLR 1.1.4322; .NET CLR 3.5.30729; .NET CLR 3.0.30618)
    • Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 1.0.3705; InfoPath.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; MS-RTC LM 8)
    • Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; GTB7.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729; .NET4.0C; .NET4.0E; OfficeLiveConnector.1.3; OfficeLivePatch.0.0)
    • Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; InfoPath.2; .NET CLR 2.0.50727; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)
    • Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; Sgrunt|V109|3060|S275053537|dialno; GTB6; InfoPath.1; .NET CLR 3.0.04506.30; .NET CLR 1.1.4322; .NET CLR 3.0.04506.648; OfficeLiveConnector.1.3; OfficeLivePatch.0.0; .NET CLR 2.0.50727; .NET
    • Mozilla/4.0 (compatible; Virtuoso)
    • Mozilla/4.0 (compatible;)
    • Mozilla/4.0 (MobilePhone PM-8200/US/1.0) NetFront/3.x MMP/2.0
    • Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)
    • Mozilla/4.5 (compatible; MSIE 6.0; Windows 98)
    • Mozilla/5.0 (BREW; U; 3.1.5; en) AppleWebKit/528.28 (KHTML, like Gecko) OBIGO/W10.1 Safari/528.5 480X800 LGE VX11000
    • Mozilla/5.0 (compatible; AhrefsBot/2.0; +http://ahrefs.com/robot/)
    • Mozilla/5.0 (compatible; AportWorm/3.2; +http://www.aport.ru/help)
    • Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml)
    • Mozilla/5.0 (compatible; AutomaticSiteMap)
    • Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
    • Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
    • Mozilla/5.0 (compatible; Charlotte/1.1; http://www.searchme.com/support/)
    • Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html)
    • Mozilla/5.0 (compatible; discobot/1.1; +http://discoveryengine.com/discobot.html)
    • Mozilla/5.0 (compatible; DotBot/1.1; http://www.dotnetdotcom.org/, crawler@dotnetdotcom.org)
    • Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)
    • Mozilla/5.0 (compatible; Ezooms/1.0; ezooms.bot@gmail.com)
    • Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
    • Mozilla/5.0 (compatible; GurujiBot/1.0; +http://www.guruji.com/en/WebmasterFAQ.html)
    • Mozilla/5.0 (compatible; mobilizer; +http://www.mobilizer.com)
    • Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server; +http://ws.daum.net/aboutWebSearch.html) Daumoa/2.0
    • Mozilla/5.0 (compatible; Reflectbot/1.0; +http://re.flect.net) AppEngine-Google; (+http://code.google.com/appengine; appid: reflectnet)
    • Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/)
    • Mozilla/5.0 (compatible; SuchbaerBot/0.83; +http://bot.suchbaer.de/info.html)
    • Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
    • Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
    • Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
    • Mozilla/5.0 (SymbianOS/9.1; U; en-us) AppleWebKit/413 (KHTML, like Gecko) Safari/413
    • Mozilla/5.0 (SymbianOS/9.1; U; en-us) AppleWebKit/413 (KHTML, like Gecko) Safari/413 es65
    • Mozilla/5.0 (SymbianOS/9.2; U; Series60/3.1 NokiaN95/11.0.026; Profile/MIDP-2.0 Configuration/CLDC-1.1 ) AppleWebKit/413 (KHTML, like Gecko) Safari/413
    • Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.13) Gecko/20080311 Firefox/2.0.0.13
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.16) Gecko/20080702 Firefox/2.0.0.16
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.8) Gecko/2009032609 Firefox/3.0.8
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.1) Gecko/20090715 Firefox/3.5.1 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (X11; I; Linux 2.6.22-gentoo-r8 x86_64) Gecko/20071115 Firefox/2.0.0.10
    • Mozilla/5.0 (X11; U; Linux i686; en-US) AppleWebKit/534.13 (KHTML, like Gecko) Chrome/9.0.597.98 Safari/534.13
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:Spinn3r (Spinn3r 3.1); http://spinn3r.com/robot) Gecko/20021130
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.7) Gecko/20060909 Firefox/1.5.0.7 MG(Novarra-Vision/6.9)
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.14) Gecko/2009090216 Ubuntu/9.04 (jaunty) Firefox/3.0.14
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.14) Gecko/2009090216 Ubuntu/9.04 (jaunty) Firefox/3.0.14 (via babelfish.yahoo.com)
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1b1pre) Gecko/20080915000512 SeaMonkey/2.0a1pre
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1b1pre) Gecko/20080915000512 SeaMonkey/2.0a1pre (via babelfish.yahoo.com)
    • Mozilla/5.0 SixXS-IPv6Gate/3.1 (IPv6 to IPv4 Gateway; http://www.sixxs.net/tools/gateway/; info@sixxs.net) ForwardedFor/2001:da8:2000:2192:230:48ff:fecb:b918 2001:da8:2000:2192:230:48ff:fecb:b918
    • Mozilla/5.0 SixXS-IPv6Gate/3.1 (IPv6 to IPv4 Gateway; http://www.sixxs.net/tools/gateway/; info@sixxs.net) ForwardedFor/2001:da8:2000:2192::510 2001:da8:2000:2192::510
    • Mozilla/5.0 SixXS-IPv6Gate/3.1 (IPv6 to IPv4 Gateway; http://www.sixxs.net/tools/gateway/; info@sixxs.net) ForwardedFor/2001:da8:2000:2192::620 2001:da8:2000:2192::620
    • msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)
    • msnbot/1.0 (+http://search.msn.com/msnbot.htm)
    • msnbot/1.1 (+http://search.msn.com/msnbot.htm)
    • msnbot/2.0b
    • msnbot/2.0b (+http://search.msn.com/msnbot.htm)
    • msnbot/2.0b (+http://search.msn.com/msnbot.htm).
    • msnbot/2.0b (+http://search.msn.com/msnbot.htm)._
    • MSNBOT_Mobile MSMOBOT Mozilla/2.0 (compatible; MSIE 4.02; Windows CE; Default)/1.1 (+http://search.msn.com/msnbot.htm)
    • MSRBOT (http://research.microsoft.com/research/sv/msrbot/)
    • NG/2.0
    • Nokia3108/1.0 (05.08) Profile/MIDP-1.0 Configuration/CLDC-1.0
    • Nokia6820/2.0 (4.83) Profile/MIDP-1.0 Configuration/CLDC-1.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
    • nu_tch-princeton/Nu_tch-1.0-dev (princeton crawler for cass project; http://www.cs.princeton.edu/cass/; zhewang a_t cs ddot princeton dot edu)
    • Opera/9.23 (Windows NT 5.1; U; en)
    • Opera/9.52 (Windows NT 5.1; U; en)
    • Opera/9.62 (Windows NT 5.1; U; en)
    • Opera/9.64 (Windows NT 5.1; U; en)
    • Opera/9.80 (Windows NT 5.1; U; en) Presto/2.2.15 Version/10.10
    • Opera/9.80 (Windows NT 5.1; U; en) Presto/2.6.30 Version/10.62
    • Peter Wang/Nutch-1.0 (Nutch spiderman; http://peterpuwang.googlepages.com ; MyEmail)
    • porn_viewer larbin2.6.3@unspecified.mail
    • psbot/0.1 (+http://www.picsearch.com/bot.html)
    • psnsearch
    • Python-urllib/1.16
    • renlifangbot/1.0 (+http://search.msn.com/msnbot.htm)
    • SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
    • SAP-KM/WebRepository 1.2
    • SapphireWebCrawler/Nutch-1.0-dev (Sapphire Web Crawler using Nutch; http://boston.lti.cs.cmu.edu/crawler/; mhoy@cs.cmu.edu)
    • schnuffie/Nutch-1.0 (just a test)
    • SD Crawler/Nutch-0.9 (automated Crawler)
    • search crawler/Nutch-1.3-dev (crawl bot for the searcher)
    • Seekbot/1.0 (http://www.seekbot.net/bot.html) HTTPFetcher/2.2
    • swanbot
    • Teleport Pro/1.59
    • Teoma/Nutch-1.0 ( Question and Answer Search; afarm.com; bot@afarm.com)
    • Teoma/Nutch-1.0 ( Question and Answer Search; bot@afarm.com)
    • TestBot 1.0
    • W3C_Validator/1.581
    • Web-sniffer/1.0.28 (+http://web-sniffer.net/)
    • WebCopier v5.0
    • Webcrawler/Nutch-1.0-dev (Test crawl; lucene.apache.org/nutch/; a@b.net)
    • webmeasurement-bot/Nutch-1.2 (http://rvs.informatik.uni-leipzig.de/bot.php)
    • Wget/1.10.2
    • Wget/1.10.2 (Red Hat modified)
    • Wget/1.11.1 (Red Hat modified)
    • Wget/1.11.3
    • Wget/1.11.4
    • Wget/1.11.4 Red Hat modified
    • Wget/1.12 (darwin10.2.0)
    • Wget/1.12 (linux-gnu)
    • Wget/1.12-devel
    • Wget/1.8.2
    • Wget/1.9+cvs-dev-200312170931
    • Wget/1.9+cvs-stable (Red Hat modified)
    • Wget/1.9.1
    • Yandex/1.01.001 (compatible; Win16; I)
    • YandexSomething/1.0
    • Yanga WorldSearch Bot v1.1/beta (http://www.yanga.co.uk/)
    • yrspider Mozilla/5.0 (compatible; YRSpider; +http://www.yunrang.com/yrspider.html)
    • ZanranCrawler/0.2 (helpdesk@zanran.com)
    • Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; WOW64; Trident/5.0)
    • NokiaN73-1/3.0704.1.0.1 Series60/3.0 Profile/MIDP-2.0 Configuration/CLDC-1.1
    • 9090
    • Arquivo-web-crawler (compatible; heritrix/1.14.3 +http://arquivo.pt/faq-crawling)
    • HUAWEI-M328/001.00 ACS-NetFront/3.2
    • LGE-LG290C/1.0[TF268435458513872793000000014176699802] UP.Browser/6.2.3.8 (GUI) MMP/2.0
    • MOT-A-B7/01.00 UP.Browser/7.2.7.2.520 (GUI) MMP/2.0 Push/PO UP.Link/5.1.2.17
    • Mozilla
    • Mozilla/4.0 (compatible; MSIE 5.0; Windows NT 4.0)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; PalmSource/hspr-H102; Blazer/4.2) 16;320x320
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) Opera 8.65 [en]
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)
    • Mozilla/4.0 (PSP (PlayStation Portable); 2.00)
    • Mozilla/4.1 (compatible; Symbian OS; Series 60) Teleca/Q7.0
    • Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)
    • Mozilla/5.0 (BREW; U; 3.1.5; en) AppleWebKit/528.28 (KHTML, like Gecko) OBIGO/W10.0 Safari/528.5 480X800 LGE VX11000
    • Mozilla/5.0 (BREW; U; 3.1.5; en) AppleWebKit/528.28 (KHTML, like Gecko) OBIGO/W10.1 Safari/528.5 480X800 LGE VX11000
    • Mozilla/5.0 (compatible; heritrix/1.14.0 +http://www.fscals.com)
    • Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; WOW64; Trident/5.0)
    • Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
    • Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
    • Mozilla/5.0 (Linux; U; Android 0.5; en-us) AppleWebKit/522+ (KHTML, like Gecko) Safari/419.3
    • Mozilla/5.0 (Linux; U; Android 1.0; en-us; generic) AppleWebKit/525.10+ (KHTML, like Gecko) Version/3.0.4 Mobile Safari/523.12.2
    • Mozilla/5.0 (Linux; U; Android 2.3.3; ja-jp; sdk Build/GRI34) AppleWebKit/528.4 (KHTML, like Gecko) Safari/1.0
    • Mozilla/5.0 (Linux; U; Android 2.3.3; ja-jp; sdk Build/GRI34) AppleWebKit/534.23 (KHTML, like Gecko) Safari/1.0
    • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.0.7) Gecko/2009021906 Firefox/3.0.7
    • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1.1) Gecko/20090715 Firefox/3.5.1
    • Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/523.12.2 (KHTML, like Gecko) Version/3.0.4 Safari/523.12.2
    • Mozilla/5.0 (Windows NT 5.1) AppleWebKit/534.30 (KHTML, like Gecko) Chrome/12.0.742.112 Safari/534.30
    • Mozilla/5.0 (Windows NT 5.1) AppleWebKit/534.30 (KHTML, like Gecko) Chrome/12.0.742.122 Safari/534.30
    • Mozilla/5.0 (Windows NT 5.1) AppleWebKit/535.1 (KHTML, like Gecko) Chrome/13.0.782.99 Safari/535.1
    • Mozilla/5.0 (Windows NT 5.1; rv:2.0.1) Gecko/20100101 Firefox/4.0.1
    • Mozilla/5.0 (Windows NT 5.1; rv:2.0b9) Gecko/20100101 Firefox/4.0b9
    • Mozilla/5.0 (Windows NT 6.1; rv:8.0.1) Gecko/20100101 Firefox/8.0.1
    • Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534+ (KHTML, like Gecko)
    • Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534+ (KHTML, like Gecko) BingPreview/1.0b
    • Mozilla/5.0 (Windows NT 6.1; WOW64; rv:10.0) Gecko/20100101 Firefox/10.0
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; da; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.2) Gecko/2008091620 Firefox/3.0.2 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.5) Gecko/2008120122 Firefox/3.0.5 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/528+ (KHTML, like Gecko) Version/3.1.2 Safari/525.21
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/530.5 (KHTML, like Gecko) Chrome/2.0.172.6 Safari/530.5
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/532.0 (KHTML, like Gecko) Chrome/3.0.195.27 Safari/532.0
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/532.0 (KHTML, like Gecko) Chrome/3.0.195.33 Safari/532.0
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/532.5 (KHTML, like Gecko) Chrome/4.1.249.1064 Safari/532.5
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/534.10 (KHTML, like Gecko) Chrome/8.0.552.224 Safari/534.10
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/534.16 (KHTML, like Gecko) Chrome/10.0.648.204 Safari/534.16
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/534.16 (KHTML, like Gecko) Chrome/10.0.648.205 Safari/534.16
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/534.7 (KHTML, like Gecko) Chrome/7.0.517.41 Safari/534.7
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.16) Gecko/20080702 Firefox/2.0.0.16
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.20) Gecko/20081217 Firefox/2.0.0.20
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.12) Gecko/2009070611 Firefox/3.0.12
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.15) Gecko/2009101601 Firefox/3.0.15 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.16) Gecko/2009120208 Firefox/3.0.16 ( .NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.4) Gecko/2008102920 Firefox/3.0.4
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.5) Gecko/2008120122 Firefox/3.0.5
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.8) Gecko/2009032609 Firefox/3.0.8
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.9) Gecko/2009040821 Firefox/3.0.9 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en; like Gecko) Obigo/Q7
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; es-ES; rv:1.9.0.6) Gecko/2009011913 Firefox/3.0.6
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; es-ES; rv:1.9.0.8) Gecko/2009032609 Firefox/3.0.8
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.9.1.7) Gecko/20091221 Firefox/3.5.7
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.9.1.7) Gecko/20091221 Firefox/3.5.7 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.9.2) Gecko/20100115 Firefox/3.6 ( .NET CLR 3.5.30729; .NET4.0E)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; ko-KR) AppleWebKit/528+ (KHTML, like Gecko) Version/3.2.1 Safari/525.27.1
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; ko-KR) AppleWebKit/531.21.8 (KHTML, like Gecko) Version/4.0.4 Safari/531.21.10
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; ko; rv:1.9.0.7) Gecko/2009021910 Firefox/3.0.7
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; ko; rv:1.9.1.5) Gecko/20091102 Firefox/3.5.5 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; ko; rv:1.9.2.16) Gecko/20110319 Firefox/3.6.16 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US) AppleWebKit/532.5 (KHTML, like Gecko) Chrome/4.1.249.1036 Safari/532.5
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US) AppleWebKit/532.5 (KHTML, like Gecko) Chrome/4.1.249.1059 Safari/532.5
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.5) Gecko/2008120122 Firefox/3.0.5
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.1) Gecko/20090715 Firefox/3.5.1 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; it; rv:1.9.1.7) Gecko/20091221 Firefox/3.5.7 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (X11; U; Linux i686 (x86_64); en-US; rv:1.8.1.4) Gecko/20080721 BonEcho/2.0.0.4
    • Mozilla/5.0 (X11; U; Linux i686; de; rv:1.9.0.3) Gecko/2008092510 Ubuntu/8.04 (hardy) Firefox/3.0.3 FirePHP/0.1.2
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.7) Gecko/20060909 Firefox/1.5.0.7 MG(Novarra-Vision/6.9)
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1) Gecko/20060601 Firefox/2.0 (Ubuntu-edgy)
    • Mozilla/5.0 (X11; U; Linux i686; en; rv:1.8.1.11) Gecko/20071204 Epiphany/2.20 Firefox/2.0.0.11
    • Opera/9.24 (X11; Linux i686; U; en)
    • Opera/9.50 (J2ME/MIDP; Opera Mini/4.0.9751/230; U; fr)
    • Opera/9.50 (J2ME/MIDP; Opera Mini/4.0.9800/230; U; en)
    • Opera/9.50 (Windows NT 5.1; U; en)
    • Opera/9.60 (J2ME/MIDP; Opera Mini/4.0.8462/670; U; en) Presto/2.2.0
    • Opera/9.60 (J2ME/MIDP; Opera Mini/4.0.8462/786; U; en) Presto/2.2.0
    • Opera/9.80 (J2ME/MIDP; Opera Mini/4.1.15082/26.1407; U; en) Presto/2.8.119 Version/10.54
    • Opera/9.80 (J2ME/MIDP; Opera Mini/4.3.25172/25.677; U; en) Presto/2.5.25 Version/10.54
    • Opera/9.80 (J2ME/MIDP; Opera Mini/4.4.28000/26.1411; U; en) Presto/2.8.119 Version/10.54
    • Opera/9.80 (Windows NT 5.1; U; ko) Presto/2.2.15 Version/10.10
    • Opera/9.80 (Windows NT 5.1; U; ko) Presto/2.5.24 Version/10.53
    • Opera/9.80 (Windows NT 5.1; U; ko) Presto/2.6.30 Version/10.63
    • Opera/9.80 (Windows NT 5.1; U; ko) Presto/2.8.131 Version/11.11
    • Opera/9.80 (Windows NT 5.1; U; ko) Presto/2.9.168 Version/11.50
    • Opera/9.80 (Windows NT 5.1; U; zh-tw) Presto/2.9.168 Version/11.50
    • SAMSUNG-GT-M8800/M8800XXHIA SHP/VPP/R5 NetFront/3.5 Qtv5.3 SMM-MMS/1.2.0 profile/MIDP-2.1 configuration/CLDC-1.1
    • SAMSUNG-S8000/1.0 SHP/VPP/R5 Jasmine/1.0 Nextreaming SMM-MMS/1.2.0 profile/MIDP-2.1 configuration/CLDC-1.1
    • SAMSUNG-SGH-T239/T239UVIA4 NetFront/3.4 Profile/MIDP-2.0 Configuration/CLDC-1.1
    • SAMSUNG-SGH-T349/T349UVIB3 NetFront/3.5 Profile/MIDP-2.0 Configuration/CLDC-1.1
    • SAMSUNG-SGH-T749/T749UVIC6 SHP/VPP/R5 NetFront/3.5 SMM-MMS/1.2.0 profile/MIDP-2.1 configuration/CLDC-1.1
    • SonyEricssonCS8/R1DA Browser/NetFront/3.4 Profile/MIDP-2.1 Configuration/CLDC-1.1 JavaPlatform/JP-8.4.1
    • SonyEricssonK800i/R1JG Browser/NetFront/3.3 Profile/MIDP-2.0 Configuration/CLDC-1.1
    • Wget/1.10.2
    • Wget/1.10.2 (Red Hat modified)
    • Wget/1.11.3
    • Wget/1.11.4
    • Wget/1.11.4 Red Hat modified
    • Wget/1.12 (linux-gnu)
    • Yanga WorldSearch Bot v1.1/beta (http://www.yanga.co.uk/)
    • zibber-v0.1(www.zibb.com/crawler/)
    Object with no type set, valid content-type
    • AppEngine-Google; (+http://code.google.com/appengine; appid: freesurf003)
    • AppEngine-Google; (+http://code.google.com/appengine; appid: g-proxy)
    • AppEngine-Google; (+http://code.google.com/appengine; appid: mqbrokeraccess)
    • AppEngine-Google; (+http://code.google.com/appengine; appid: s~vulture-engine)
    • Baiduspider+(+http://www.baidu.com/search/spider.htm)
    • BlackBerry8520/4.6.1.195 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/100
    • BlackBerry8520/4.6.1.227 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/100
    • BlackBerry8703e/4.1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/105
    • BlackBerry8900/5.0.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/-1
    • BlackBerry9700/5.0.0 Profile/MIDP-2.1 Configuration/CLDC-1.1 VendorID/179
    • CCBot/1.0 (+http://www.commoncrawl.org/bot.html)
    • Crawler0.1
    • DoCoMo/1.0/N505i/c20/TB/W20H10 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
    • DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
    • DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo; +http://help.goo.ne.jp/help/article/1142/)
    • FAST Enterprise Crawler/6.7.0 (crawler@fast.no)
    • Gaisbot/3.0+(robot06@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot.php)
    • Gigabot/3.0 (http://www.gigablast.com/spider.html)
    • Goldfire Server
    • googlebot search@socbay.com
    • gosospider Mozilla/5.0 (compatible; GosoSpider; +http://www.goso.cn/aboutus.html)
    • gsa-crawler (Enterprise; S5-MPGS7LJ5TGSAB; ewk@uakron.edu)
    • GurujiBot/1.0 (+http://www.guruji.com/en/WebmasterFAQ.html)
    • HablaCentro/1.0 (HablaCentro Crawler; http://hablacentro.com/; webmaster@hablacentro.com)
    • HD nutch agent/1.0
    • http://mycompany.com/es/crawler
    • ia_archiver
    • ia_archiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com)
    • ICC-Crawler/2.0 (Mozilla-compatible; ; http://kc.nict.go.jp/project1/crawl.html)
    • ichiro/3.0 (http://help.goo.ne.jp/door/crawler.html)
    • Internet Explorer
    • Internet Explorer 8.0
    • Isidorus/2.0 (Isidorus; http://www.isidorus.com; crawler@isidorus.com)
    • Java/1.6.0_0
    • Keybot Translation-Search-Machine
    • larbin_2.6.3 m.p.griffiths@cranfield.ac.uk
    • librabot/1.0 (+http://search.msn.com/msnbot.htm)
    • librabot/2.0 (+http://academic.research.microsoft.com/)
    • librabot/2.0/1.0 (+http://search.msn.com/msnbot.htm)
    • loalasam (loalasam@263.com)
    • Mail.Ru/1.0
    • Mozilla
    • Mozilla/2.0 (compatible; MSIE 3.02; Update a; AOL 3.0; Windows 95)
    • Mozilla/2.0 (compatible; MSIE 4.0; Windows 98)
    • Mozilla/3.0(DDIPOCKET;KYOCERA/AH-K3001V/1.8.3.72.000000/0.1/C100) Opera 7.0
    • Mozilla/4.0
    • Mozilla/4.0 (compatible; ICS)
    • Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 5.0 Robot)
    • Mozilla/4.0 (compatible; MSIE 5.0; Windows 98)
    • Mozilla/4.0 (compatible; MSIE 5.0; Windows NT 4.0)
    • Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt)
    • Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt; DTS Agent
    • Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0)
    • Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) Fetch API Request
    • Mozilla/4.0 (compatible; MSIE 6.0)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows CE; IEMobile 8.12; MSIEMobile 6.0) T-Mobile_Maple
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows CE; IEMobile 8.12; MSIEMobile 6.0) T-Mobile_Rhodium
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; Google Wireless Transcoder;)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; InfoPath.1)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; InfoPath.1)
    • Mozilla/4.0 (Compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727; .NET CLR 1.1.4322)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648; InfoPath.1)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; GTB5; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Maxthon; .NET CLR 1.0.3705; .NET CLR 2.0.50727; .NET CLR 1.1.4322; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Maxthon; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 1.0.3705; .NET CLR 1.1.4322)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; xs-nwo59GiQ0mE; .NET CLR 2.0.50727; .NET CLR 1.1.4322)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; InfoPath.1; .NET CLR 3.0.04506.30; MS-RTC LM 8)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; ABCPlayer_1.3.19; ITVPlayer_1.3.22; .NET CLR 2.0.50727; .NET CLR 1.1.4322; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022; InfoPath.2)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; Mobivillage; .NET CLR 1.1.4322; .NET CLR 2.0.50727; Mobivillage; Mobivillage)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; SV1)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; SLCC1; .NET CLR 2.0.50727; .NET CLR 1.1.4322; .NET CLR 3.5.21022; .NET CLR 3.5.30729; .NET CLR 3.0.30729; OfficeLiveConnector.1.4; OfficeLivePatch.1.3; Creative AutoUpdate v1.10.10)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; WOW64; Trident/4.0; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; SLCC1; .NET CLR 2.0.50727; Media Center PC 5.0; InfoPath.2; .NET CLR 1.1.4322; .NET CLR 3.5.30729; .NET CLR 3.0.30618)
    • Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0)
    • Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; GTB7.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729; .NET4.0C; .NET4.0E; OfficeLiveConnector.1.3; OfficeLivePatch.0.0)
    • Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; InfoPath.2; .NET CLR 2.0.50727; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)
    • Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; Sgrunt|V109|3060|S275053537|dialno; GTB6; InfoPath.1; .NET CLR 3.0.04506.30; .NET CLR 1.1.4322; .NET CLR 3.0.04506.648; OfficeLiveConnector.1.3; OfficeLivePatch.0.0; .NET CLR 2.0.50727; .NET
    • Mozilla/4.0 (compatible; Virtuoso)
    • Mozilla/4.0 (compatible;)
    • Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)
    • Mozilla/4.5 (compatible; MSIE 6.0; Windows 98)
    • Mozilla/5.0 (compatible; AhrefsBot/2.0; +http://ahrefs.com/robot/)
    • Mozilla/5.0 (compatible; AportWorm/3.2; +http://www.aport.ru/help)
    • Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml)
    • Mozilla/5.0 (compatible; AutomaticSiteMap)
    • Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
    • Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
    • Mozilla/5.0 (compatible; Charlotte/1.1; http://www.searchme.com/support/)
    • Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html)
    • Mozilla/5.0 (compatible; discobot/1.1; +http://discoveryengine.com/discobot.html)
    • Mozilla/5.0 (compatible; DotBot/1.1; http://www.dotnetdotcom.org/, crawler@dotnetdotcom.org)
    • Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)
    • Mozilla/5.0 (compatible; Ezooms/1.0; ezooms.bot@gmail.com)
    • Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
    • Mozilla/5.0 (compatible; GurujiBot/1.0; +http://www.guruji.com/en/WebmasterFAQ.html)
    • Mozilla/5.0 (compatible; mobilizer; +http://www.mobilizer.com)
    • Mozilla/5.0 (compatible; MSIE 7.0; Windows NT 5.2; WOW64; .NET CLR 2.0.50727)
    • Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server; +http://ws.daum.net/aboutWebSearch.html) Daumoa/2.0
    • Mozilla/5.0 (compatible; Reflectbot/1.0; +http://re.flect.net) AppEngine-Google; (+http://code.google.com/appengine; appid: reflectnet)
    • Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/)
    • Mozilla/5.0 (compatible; SuchbaerBot/0.83; +http://bot.suchbaer.de/info.html)
    • Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
    • Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
    • Mozilla/5.0 (en-us) AppleWebKit/525.13 (KHTML, like Gecko; Google Wireless Transcoder) Version/3.1 Safari/525.13
    • Mozilla/5.0 (SymbianOS/9.1; U; en-us) AppleWebKit/413 (KHTML, like Gecko) Safari/413
    • Mozilla/5.0 (SymbianOS/9.1; U; en-us) AppleWebKit/413 (KHTML, like Gecko) Safari/413 es65
    • Mozilla/5.0 (SymbianOS/9.2; U; Series60/3.1 NokiaN95/11.0.026; Profile/MIDP-2.0 Configuration/CLDC-1.1 ) AppleWebKit/413 (KHTML, like Gecko) Safari/413
    • Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html)
    • Mozilla/5.0 (Windows NT 5.1) AppleWebKit/534.30 (KHTML, like Gecko) Chrome/12.0.742.122 Safari/534.30
    • Mozilla/5.0 (Windows; U; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.8) Gecko/2009032609 Firefox/3.0.8
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (X11; I; Linux 2.6.22-gentoo-r8 x86_64) Gecko/20071115 Firefox/2.0.0.10
    • Mozilla/5.0 (X11; U; Linux i686; en-US) AppleWebKit/534.13 (KHTML, like Gecko) Chrome/9.0.597.98 Safari/534.13
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:Spinn3r (Spinn3r 3.1); http://spinn3r.com/robot) Gecko/20021130
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.7) Gecko/20060909 Firefox/1.5.0.7 MG(Novarra-Vision/6.9)
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.14) Gecko/2009090216 Ubuntu/9.04 (jaunty) Firefox/3.0.14
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.14) Gecko/2009090216 Ubuntu/9.04 (jaunty) Firefox/3.0.14 (via babelfish.yahoo.com)
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1b1pre) Gecko/20080915000512 SeaMonkey/2.0a1pre
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1b1pre) Gecko/20080915000512 SeaMonkey/2.0a1pre (via babelfish.yahoo.com)
    • Mozilla/5.0 SixXS-IPv6Gate/3.1 (IPv6 to IPv4 Gateway; http://www.sixxs.net/tools/gateway/; info@sixxs.net) ForwardedFor/2001:da8:2000:2192:230:48ff:fecb:b918 2001:da8:2000:2192:230:48ff:fecb:b918
    • Mozilla/5.0 SixXS-IPv6Gate/3.1 (IPv6 to IPv4 Gateway; http://www.sixxs.net/tools/gateway/; info@sixxs.net) ForwardedFor/2001:da8:2000:2192::510 2001:da8:2000:2192::510
    • Mozilla/5.0 SixXS-IPv6Gate/3.1 (IPv6 to IPv4 Gateway; http://www.sixxs.net/tools/gateway/; info@sixxs.net) ForwardedFor/2001:da8:2000:2192::620 2001:da8:2000:2192::620
    • msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)
    • msnbot/1.0 (+http://search.msn.com/msnbot.htm)
    • msnbot/1.1 (+http://search.msn.com/msnbot.htm)
    • msnbot/2.0b
    • msnbot/2.0b (+http://search.msn.com/msnbot.htm)
    • msnbot/2.0b (+http://search.msn.com/msnbot.htm).
    • msnbot/2.0b (+http://search.msn.com/msnbot.htm)._
    • MSNBOT_Mobile MSMOBOT Mozilla/2.0 (compatible; MSIE 4.02; Windows CE; Default)/1.1 (+http://search.msn.com/msnbot.htm)
    • MSRBOT (http://research.microsoft.com/research/sv/msrbot/)
    • NG/2.0
    • Nokia3108/1.0 (05.08) Profile/MIDP-1.0 Configuration/CLDC-1.0
    • Nokia6820/2.0 (4.83) Profile/MIDP-1.0 Configuration/CLDC-1.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
    • nu_tch-princeton/Nu_tch-1.0-dev (princeton crawler for cass project; http://www.cs.princeton.edu/cass/; zhewang a_t cs ddot princeton dot edu)
    • Opera/5.0 (Linux 2.0.38 i386; U) [en]
    • Opera/9.23 (Windows NT 5.1; U; en)
    • Opera/9.52 (Windows NT 5.1; U; en)
    • Opera/9.62 (Windows NT 5.1; U; en)
    • Opera/9.80 (Windows NT 5.1; U; en) Presto/2.2.15 Version/10.10
    • Opera/9.80 (Windows NT 5.1; U; en) Presto/2.6.30 Version/10.62
    • porn_viewer larbin2.6.3@unspecified.mail
    • psbot/0.1 (+http://www.picsearch.com/bot.html)
    • psnsearch
    • Python-urllib/1.16
    • SAMSUNG-C5212/C5212XEIC3 NetFront/3.4 Profile/MIDP-2.0 Configuration/CLDC-1.1
    • SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
    • SAP-KM/WebRepository 1.2
    • schnuffie/Nutch-1.0 (just a test)
    • SD Crawler/Nutch-0.9 (automated Crawler)
    • search crawler/Nutch-1.3-dev (crawl bot for the searcher)
    • Seekbot/1.0 (http://www.seekbot.net/bot.html) HTTPFetcher/2.2
    • Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/)
    • swanbot
    • Teleport Pro/1.59
    • Teoma/Nutch-1.0 ( Question and Answer Search; afarm.com; bot@afarm.com)
    • Teoma/Nutch-1.0 ( Question and Answer Search; bot@afarm.com)
    • TestBot 1.0
    • W3C_Validator/1.581
    • WebCopier v5.0
    • Webcrawler/Nutch-1.0-dev (Test crawl; lucene.apache.org/nutch/; a@b.net)
    • webmeasurement-bot/Nutch-1.2 (http://rvs.informatik.uni-leipzig.de/bot.php)
    • Wget/1.10.2
    • Wget/1.10.2 (Red Hat modified)
    • Wget/1.11.1 (Red Hat modified)
    • Wget/1.11.3
    • Wget/1.11.4
    • Wget/1.11.4 Red Hat modified
    • Wget/1.12 (darwin10.2.0)
    • Wget/1.12 (linux-gnu)
    • Wget/1.12-devel
    • Wget/1.8.2
    • Wget/1.9+cvs-dev-200312170931
    • Wget/1.9+cvs-stable (Red Hat modified)
    • Wget/1.9.1
    • Yandex/1.01.001 (compatible; Win16; I)
    • Yanga WorldSearch Bot v1.1/beta (http://www.yanga.co.uk/)
    • yrspider Mozilla/5.0 (compatible; YRSpider; +http://www.yunrang.com/yrspider.html)
    • ZanranCrawler/0.2 (helpdesk@zanran.com)
    • NokiaN73-1/3.0704.1.0.1 Series60/3.0 Profile/MIDP-2.0 Configuration/CLDC-1.1
    • Wget/1.12 (linux-gnu)
    • 9090
    • Arquivo-web-crawler (compatible; heritrix/1.14.3 +http://arquivo.pt/faq-crawling)
    • HUAWEI-M328/001.00 ACS-NetFront/3.2
    • LGE-LG290C/1.0[TF268435458513872793000000014176699802] UP.Browser/6.2.3.8 (GUI) MMP/2.0
    • MOT-A-B7/01.00 UP.Browser/7.2.7.2.520 (GUI) MMP/2.0 Push/PO UP.Link/5.1.2.17
    • Mozilla
    • Mozilla/4.0 (compatible; MSIE 5.0; Windows NT 4.0)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; PalmSource/hspr-H102; Blazer/4.2) 16;320x320
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) Opera 8.65 [en]
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)
    • Mozilla/4.0 (PSP (PlayStation Portable); 2.00)
    • Mozilla/4.1 (compatible; Symbian OS; Series 60) Teleca/Q7.0
    • Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)
    • Mozilla/5.0 (BREW; U; 3.1.5; en) AppleWebKit/528.28 (KHTML, like Gecko) OBIGO/W10.1 Safari/528.5 480X800 LGE VX11000
    • Mozilla/5.0 (compatible; heritrix/1.14.0 +http://www.fscals.com)
    • Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; WOW64; Trident/5.0)
    • Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
    • Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
    • Mozilla/5.0 (Linux; U; Android 0.5; en-us) AppleWebKit/522+ (KHTML, like Gecko) Safari/419.3
    • Mozilla/5.0 (Linux; U; Android 2.3.3; ja-jp; sdk Build/GRI34) AppleWebKit/528.4 (KHTML, like Gecko) Safari/1.0
    • Mozilla/5.0 (Linux; U; Android 2.3.3; ja-jp; sdk Build/GRI34) AppleWebKit/533.1 (KHTML, like Gecko) TmmBrowser/1.0
    • Mozilla/5.0 (Linux; U; Android 2.3.3; ja-jp; sdk Build/GRI34) AppleWebKit/534.23 (KHTML, like Gecko) TmmBrowser/1.0
    • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.0.7) Gecko/2009021906 Firefox/3.0.7
    • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1.1) Gecko/20090715 Firefox/3.5.1
    • Mozilla/5.0 (Macintosh; U; Intel Mac OS X; sv-SE; rv:1.8.1.13) Gecko/20080311 Firefox/2.0.0.13
    • Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/523.12.2 (KHTML, like Gecko) Version/3.0.4 Safari/523.12.2
    • Mozilla/5.0 (Windows NT 5.1) AppleWebKit/534.30 (KHTML, like Gecko) Chrome/12.0.742.112 Safari/534.30
    • Mozilla/5.0 (Windows NT 5.1) AppleWebKit/534.30 (KHTML, like Gecko) Chrome/12.0.742.122 Safari/534.30
    • Mozilla/5.0 (Windows NT 5.1) AppleWebKit/535.1 (KHTML, like Gecko) Chrome/13.0.782.99 Safari/535.1
    • Mozilla/5.0 (Windows NT 5.1; rv:2.0.1) Gecko/20100101 Firefox/4.0.1
    • Mozilla/5.0 (Windows NT 5.1; rv:2.0b9) Gecko/20100101 Firefox/4.0b9
    • Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534+ (KHTML, like Gecko) BingPreview/1.0b
    • Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/535.1 (KHTML, like Gecko) Chrome/13.0.782.107 Safari/535.1
    • Mozilla/5.0 (Windows NT 6.1; WOW64; rv:10.0) Gecko/20100101 Firefox/10.0
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; da; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.2) Gecko/2008091620 Firefox/3.0.2 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.5) Gecko/2008120122 Firefox/3.0.5 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/525.19 (KHTML, like Gecko) Chrome/1.0.154.36 Safari/525.19
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/528+ (KHTML, like Gecko) Version/3.1.2 Safari/525.21
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/532.0 (KHTML, like Gecko) Chrome/3.0.195.27 Safari/532.0
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/532.5 (KHTML, like Gecko) Chrome/4.1.249.1064 Safari/532.5
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/534.10 (KHTML, like Gecko) Chrome/8.0.552.224 Safari/534.10
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/534.16 (KHTML, like Gecko) Chrome/10.0.648.204 Safari/534.16
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/534.16 (KHTML, like Gecko) Chrome/10.0.648.205 Safari/534.16
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/534.7 (KHTML, like Gecko) Chrome/7.0.517.41 Safari/534.7
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.16) Gecko/20080702 Firefox/2.0.0.16
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.20) Gecko/20081217 Firefox/2.0.0.20
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.12) Gecko/2009070611 Firefox/3.0.12
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.15) Gecko/2009101601 Firefox/3.0.15 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.3) Gecko/2008092417 Firefox/3.0.3
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.4) Gecko/2008102920 Firefox/3.0.4
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.5) Gecko/2008120122 Firefox/3.0.5
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.8) Gecko/2009032609 Firefox/3.0.8
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.9) Gecko/2009040821 Firefox/3.0.9 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1) Gecko/20090615 Firefox/3.5 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.2) Gecko/20090729 Firefox/3.5.2
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.3) Gecko/20090824 Firefox/3.5.3
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.10) Gecko/20100914 Firefox/3.6.10 ( .NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en; like Gecko) Obigo/Q7
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; es-ES; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; es-ES; rv:1.9.0.6) Gecko/2009011913 Firefox/3.0.6
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; es-ES; rv:1.9.0.8) Gecko/2009032609 Firefox/3.0.8
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.9.1.7) Gecko/20091221 Firefox/3.5.7
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.9.1.7) Gecko/20091221 Firefox/3.5.7 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; ko; rv:1.9.0.7) Gecko/2009021910 Firefox/3.0.7
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; ko; rv:1.9.2.16) Gecko/20110319 Firefox/3.6.16 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; rv:1.9.1.7) Gecko/20091221 Firefox/3.5.7 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-TW; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US) AppleWebKit/532.5 (KHTML, like Gecko) Chrome/4.1.249.1036 Safari/532.5
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.5) Gecko/2008120122 Firefox/3.0.5
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.7) Gecko/2009021910 Firefox/3.0.4, Ant.com Toolbar 1.1
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.1) Gecko/20090715 Firefox/3.5.1 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; it; rv:1.9.1.7) Gecko/20091221 Firefox/3.5.7 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (X11; U; Linux i686 (x86_64); en-US; rv:1.8.1.4) Gecko/20080721 BonEcho/2.0.0.4
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.7) Gecko/20060909 Firefox/1.5.0.7 MG(Novarra-Vision/6.9)
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1) Gecko/20060601 Firefox/2.0 (Ubuntu-edgy)
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9) Gecko/2008060309 Firefox/3.0
    • Mozilla/5.0 (X11; U; Linux i686; en; rv:1.8.1.11) Gecko/20071204 Epiphany/2.20 Firefox/2.0.0.11
    • Mozilla/5.0 (X11; U; Linux i686; ja; rv:1.9.1.8) Gecko/20100214 Ubuntu/9.10 (karmic) Firefox/3.5.8
    • Mozilla/5.0 (X11; U; Linux i686; pl-PL; rv:1.9.0.10) Gecko/2009042523 Ubuntu/9.04 (jaunty) Firefox/3.0.10
    • Opera/9.24 (X11; Linux i686; U; en)
    • Opera/9.50 (J2ME/MIDP; Opera Mini/4.0.9751/230; U; fr)
    • Opera/9.50 (J2ME/MIDP; Opera Mini/4.0.9800/230; U; en)
    • Opera/9.50 (Windows NT 5.1; U; en)
    • Opera/9.60 (J2ME/MIDP; Opera Mini/4.0.8462/670; U; en) Presto/2.2.0
    • Opera/9.64 (Windows NT 5.1; U; zh-tw) Presto/2.1.1
    • Opera/9.80 (J2ME/MIDP; Opera Mini/4.3.25172/25.677; U; en) Presto/2.5.25 Version/10.54
    • Opera/9.80 (Windows NT 5.1; U; ko) Presto/2.2.15 Version/10.10
    • Opera/9.80 (Windows NT 5.1; U; ko) Presto/2.5.24 Version/10.53
    • Opera/9.80 (Windows NT 5.1; U; ko) Presto/2.8.131 Version/11.11
    • Opera/9.80 (Windows NT 5.1; U; ko) Presto/2.9.168 Version/11.50
    • Opera/9.80 (Windows NT 5.1; U; zh-tw) Presto/2.9.168 Version/11.50
    • SAMSUNG-GT-M8800/M8800XXHIA SHP/VPP/R5 NetFront/3.5 Qtv5.3 SMM-MMS/1.2.0 profile/MIDP-2.1 configuration/CLDC-1.1
    • SAMSUNG-S8000/1.0 SHP/VPP/R5 Jasmine/1.0 Nextreaming SMM-MMS/1.2.0 profile/MIDP-2.1 configuration/CLDC-1.1
    • SAMSUNG-SGH-T239/T239UVIA4 NetFront/3.4 Profile/MIDP-2.0 Configuration/CLDC-1.1
    • SAMSUNG-SGH-T349/T349UVIB3 NetFront/3.5 Profile/MIDP-2.0 Configuration/CLDC-1.1
    • SAMSUNG-SGH-T749/T749UVIC6 SHP/VPP/R5 NetFront/3.5 SMM-MMS/1.2.0 profile/MIDP-2.1 configuration/CLDC-1.1
    • SAMSUNG-SGH-T749/T749UVIF3 SHP/VPP/R5 NetFront/3.5 SMM-MMS/1.2.0 profile/MIDP-2.1 configuration/CLDC-1.1
    • SonyEricssonCS8/R1DA Browser/NetFront/3.4 Profile/MIDP-2.1 Configuration/CLDC-1.1 JavaPlatform/JP-8.4.1
    • SonyEricssonK800i/R1JG Browser/NetFront/3.3 Profile/MIDP-2.0 Configuration/CLDC-1.1
    • SonyEricssonK800i/R1KC Browser/NetFront/3.3 Profile/MIDP-2.0 Configuration/CLDC-1.1
    • Wget/1.10.2
    • Wget/1.10.2 (Red Hat modified)
    • Wget/1.11.3
    • Wget/1.11.4
    • Wget/1.11.4 Red Hat modified
    • Wget/1.12 (linux-gnu)
    • Yanga WorldSearch Bot v1.1/beta (http://www.yanga.co.uk/)
    • zibber-v0.1(www.zibb.com/crawler/)
    Object with valid type set, valid content-type
    • AppEngine-Google; (+http://code.google.com/appengine; appid: freesurf003)
    • AppEngine-Google; (+http://code.google.com/appengine; appid: g-proxy)
    • AppEngine-Google; (+http://code.google.com/appengine; appid: mqbrokeraccess)
    • AppEngine-Google; (+http://code.google.com/appengine; appid: s~vulture-engine)
    • Baiduspider+(+http://www.baidu.com/search/spider.htm)
    • CCBot/1.0 (+http://www.commoncrawl.org/bot.html)
    • Crawler0.1
    • DoCoMo/1.0/N505i/c20/TB/W20H10 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
    • DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
    • DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo; +http://help.goo.ne.jp/help/article/1142/)
    • FAST Enterprise Crawler/6.7.0 (crawler@fast.no)
    • Gaisbot/3.0+(robot06@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot.php)
    • Gigabot/3.0 (http://www.gigablast.com/spider.html)
    • Goldfire Server
    • gsa-crawler (Enterprise; S5-MPGS7LJ5TGSAB; ewk@uakron.edu)
    • GurujiBot/1.0 (+http://www.guruji.com/en/WebmasterFAQ.html)
    • HablaCentro/1.0 (HablaCentro Crawler; http://hablacentro.com/; webmaster@hablacentro.com)
    • HD nutch agent/1.0
    • http://mycompany.com/es/crawler
    • ia_archiver
    • ia_archiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com)
    • ICC-Crawler/2.0 (Mozilla-compatible; ; http://kc.nict.go.jp/project1/crawl.html)
    • ichiro/3.0 (http://help.goo.ne.jp/door/crawler.html)
    • Internet Explorer
    • Internet Explorer 8.0
    • Isidorus/2.0 (Isidorus; http://www.isidorus.com; crawler@isidorus.com)
    • Java/1.6.0_0
    • Keybot Translation-Search-Machine
    • larbin_2.6.3 m.p.griffiths@cranfield.ac.uk
    • librabot/1.0 (+http://search.msn.com/msnbot.htm)
    • librabot/2.0 (+http://academic.research.microsoft.com/)
    • librabot/2.0/1.0 (+http://search.msn.com/msnbot.htm)
    • loalasam (loalasam@263.com)
    • Mail.Ru/1.0
    • Mozilla
    • Mozilla/2.0 (compatible; MSIE 4.0; Windows 98)
    • Mozilla/4.0
    • Mozilla/4.0 (compatible; ICS)
    • Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 5.0 Robot)
    • Mozilla/4.0 (compatible; MSIE 5.0; Windows 98)
    • Mozilla/4.0 (compatible; MSIE 5.0; Windows NT 4.0)
    • Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt)
    • Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt; DTS Agent
    • Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0)
    • Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) Fetch API Request
    • Mozilla/4.0 (compatible; MSIE 6.0)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; Google Wireless Transcoder;)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; KKman3.0)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)
    • Mozilla/4.0 (Compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727; .NET CLR 1.1.4322)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; SV1)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; WOW64; Trident/4.0; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; SLCC1; .NET CLR 2.0.50727; Media Center PC 5.0; InfoPath.2; .NET CLR 1.1.4322; .NET CLR 3.5.30729; .NET CLR 3.0.30618)
    • Mozilla/4.0 (compatible; Virtuoso)
    • Mozilla/4.0 (compatible;)
    • Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)
    • Mozilla/4.5 (compatible; MSIE 6.0; Windows 98)
    • Mozilla/4.61 [de] (OS/2; I)
    • Mozilla/5.0 (compatible; AhrefsBot/2.0; +http://ahrefs.com/robot/)
    • Mozilla/5.0 (compatible; AportWorm/3.2; +http://www.aport.ru/help)
    • Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml)
    • Mozilla/5.0 (compatible; AutomaticSiteMap)
    • Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
    • Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
    • Mozilla/5.0 (compatible; Charlotte/1.1; http://www.searchme.com/support/)
    • Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html)
    • Mozilla/5.0 (compatible; discobot/1.1; +http://discoveryengine.com/discobot.html)
    • Mozilla/5.0 (compatible; DotBot/1.1; http://www.dotnetdotcom.org/, crawler@dotnetdotcom.org)
    • Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)
    • Mozilla/5.0 (compatible; Ezooms/1.0; ezooms.bot@gmail.com)
    • Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
    • Mozilla/5.0 (compatible; GurujiBot/1.0; +http://www.guruji.com/en/WebmasterFAQ.html)
    • Mozilla/5.0 (compatible; mobilizer; +http://www.mobilizer.com)
    • Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server; +http://ws.daum.net/aboutWebSearch.html) Daumoa/2.0
    • Mozilla/5.0 (compatible; Reflectbot/1.0; +http://re.flect.net) AppEngine-Google; (+http://code.google.com/appengine; appid: reflectnet)
    • Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/)
    • Mozilla/5.0 (compatible; SuchbaerBot/0.83; +http://bot.suchbaer.de/info.html)
    • Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
    • Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
    • Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
    • Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/; )
    • Mozilla/5.0 (Linux; U; Android 0.5; en-us) AppleWebKit/522+ (KHTML, like Gecko) Safari/419.3
    • Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html)
    • Mozilla/5.0 (Windows NT 5.1) AppleWebKit/534.30 (KHTML, like Gecko) Chrome/12.0.742.122 Safari/534.30
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.7) Gecko/2009021910 Firefox/3.0.7 GTB5 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.8) Gecko/2009032609 Firefox/3.0.8
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (X11; I; Linux 2.6.22-gentoo-r8 x86_64) Gecko/20071115 Firefox/2.0.0.10
    • Mozilla/5.0 (X11; U; Linux i686 (x86_64); en-US; rv:1.8.1.4) Gecko/20080721 BonEcho/2.0.0.4
    • Mozilla/5.0 (X11; U; Linux i686; en-US) AppleWebKit/532.2 (KHTML, like Gecko) Chrome/4.0.222.5 Safari/532.2
    • Mozilla/5.0 (X11; U; Linux i686; en-US) AppleWebKit/532.2 (KHTML, like Gecko) Chrome/4.0.222.5 Safari/532.2 (via babelfish.yahoo.com)
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:Spinn3r (Spinn3r 3.1); http://spinn3r.com/robot) Gecko/20021130
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1b1pre) Gecko/20080915000512 SeaMonkey/2.0a1pre
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1b1pre) Gecko/20080915000512 SeaMonkey/2.0a1pre (via babelfish.yahoo.com)
    • Mozilla/5.0 SixXS-IPv6Gate/3.1 (IPv6 to IPv4 Gateway; http://www.sixxs.net/tools/gateway/; info@sixxs.net) ForwardedFor/2001:da8:2000:2192:230:48ff:fecb:b918 2001:da8:2000:2192:230:48ff:fecb:b918
    • Mozilla/5.0 SixXS-IPv6Gate/3.1 (IPv6 to IPv4 Gateway; http://www.sixxs.net/tools/gateway/; info@sixxs.net) ForwardedFor/2001:da8:2000:2192::510 2001:da8:2000:2192::510
    • Mozilla/5.0 SixXS-IPv6Gate/3.1 (IPv6 to IPv4 Gateway; http://www.sixxs.net/tools/gateway/; info@sixxs.net) ForwardedFor/2001:da8:2000:2192::620 2001:da8:2000:2192::620
    • msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)
    • msnbot/1.0 (+http://search.msn.com/msnbot.htm)
    • msnbot/1.1 (+http://search.msn.com/msnbot.htm)
    • msnbot/2.0b
    • msnbot/2.0b (+http://search.msn.com/msnbot.htm)
    • msnbot/2.0b (+http://search.msn.com/msnbot.htm).
    • msnbot/2.0b (+http://search.msn.com/msnbot.htm)._
    • MSNBOT_Mobile MSMOBOT Mozilla/2.0 (compatible; MSIE 4.02; Windows CE; Default)/1.1 (+http://search.msn.com/msnbot.htm)
    • MSRBOT (http://research.microsoft.com/research/sv/msrbot/)
    • NG/2.0
    • Nokia3108/1.0 (05.08) Profile/MIDP-1.0 Configuration/CLDC-1.0
    • Nokia6820/2.0 (4.83) Profile/MIDP-1.0 Configuration/CLDC-1.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
    • nu_tch-princeton/Nu_tch-1.0-dev (princeton crawler for cass project; http://www.cs.princeton.edu/cass/; zhewang a_t cs ddot princeton dot edu)
    • Opera/9.23 (Windows NT 5.1; U; en)
    • Opera/9.52 (Windows NT 5.1; U; en)
    • Opera/9.62 (Windows NT 5.1; U; en)
    • Opera/9.64 (Windows NT 5.1; U; en)
    • Opera/9.80 (Windows NT 5.1; U; en) Presto/2.2.15 Version/10.10
    • Opera/9.80 (Windows NT 5.1; U; en) Presto/2.6.30 Version/10.62
    • porn_viewer larbin2.6.3@unspecified.mail
    • psbot/0.1 (+http://www.picsearch.com/bot.html)
    • psnsearch
    • Python-urllib/1.16
    • SAMSUNG-S8000/S8000XXHC1 SHP/VPP/R5 Jasmine/1.0 Nextreaming SMM-MMS/1.2.0 profile/MIDP-2.1 configuration/CLDC-1.1 SS-Widget/S8000-FM
    • SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
    • SAP-KM/WebRepository 1.2
    • schnuffie/Nutch-1.0 (just a test)
    • SD Crawler/Nutch-0.9 (automated Crawler)
    • search crawler/Nutch-1.3-dev (crawl bot for the searcher)
    • Seekbot/1.0 (http://www.seekbot.net/bot.html) HTTPFetcher/2.2
    • swanbot
    • Teleport Pro/1.59
    • Teoma/Nutch-1.0 ( Question and Answer Search; afarm.com; bot@afarm.com)
    • Teoma/Nutch-1.0 ( Question and Answer Search; bot@afarm.com)
    • test/Nutch-0.9 (Nutch spiderman; http://www.test.test.test ; MyEmail)
    • TestBot 1.0
    • Vtiuxznh kepq syqz
    • W3C_Validator/1.575
    • W3C_Validator/1.581
    • WebCopier v5.0
    • Webcrawler/Nutch-1.0-dev (Test crawl; lucene.apache.org/nutch/; a@b.net)
    • webmeasurement-bot/Nutch-1.2 (http://rvs.informatik.uni-leipzig.de/bot.php)
    • Wget/1.10.2
    • Wget/1.10.2 (Red Hat modified)
    • Wget/1.11.1 (Red Hat modified)
    • Wget/1.11.3
    • Wget/1.11.4
    • Wget/1.11.4 Red Hat modified
    • Wget/1.12 (darwin10.2.0)
    • Wget/1.12 (linux-gnu)
    • Wget/1.12-devel
    • Wget/1.8.2
    • Wget/1.9+cvs-dev-200312170931
    • Wget/1.9+cvs-stable (Red Hat modified)
    • Wget/1.9.1
    • yacybot (amd64 Linux 2.6.28-11-generic; java 1.6.0_13; Europe/en) http://yacy.net/bot.html
    • Yandex/1.01.001 (compatible; Win16; I)
    • YandexSomething/1.0
    • Yanga WorldSearch Bot v1.1/beta (http://www.yanga.co.uk/)
    • yrspider Mozilla/5.0 (compatible; YRSpider; +http://www.yunrang.com/yrspider.html)
    • ZanranCrawler/0.2 (helpdesk@zanran.com)
    • Wget/1.12 (linux-gnu)
    • 9090
    • Arquivo-web-crawler (compatible; heritrix/1.14.3 +http://arquivo.pt/faq-crawling)
    • BlackBerry8520/4.6.1.195 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/100
    • BlackBerry8520/4.6.1.227 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/100
    • BlackBerry8703e/4.1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/105
    • BlackBerry8900/5.0.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/-1
    • BlackBerry9700/5.0.0 Profile/MIDP-2.1 Configuration/CLDC-1.1 VendorID/179
    • HTC-diamond
    • HUAWEI-M328/001.00 ACS-NetFront/3.2
    • LGE-LG290C/1.0[TF268435458513872793000000014176699802] UP.Browser/6.2.3.8 (GUI) MMP/2.0
    • MOT-A-B7/01.00 UP.Browser/7.2.7.2.520 (GUI) MMP/2.0 Push/PO UP.Link/5.1.2.17
    • Mozilla
    • Mozilla/4.0 (compatible; MSIE 5.0; Windows NT 4.0)
    • Mozilla/4.0 (compatible; MSIE 6.0; Symbian OS; Nokia N70/5.0717.3.0.1; 9424) Opera 8.65 [en]
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; PalmSource/hspr-H102; Blazer/4.2) 16;320x320
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows CE; IEMobile 8.12; MSIEMobile 6.0) T-Mobile_Maple
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows CE; IEMobile 8.12; MSIEMobile 6.0) T-Mobile_Rhodium
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) Opera 8.65 [en]
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; InfoPath.1)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; InfoPath.1)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648; InfoPath.1)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727; InfoPath.1; MS-RTC LM 8)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; GTB5; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; InfoPath.1; .NET CLR 1.1.4322)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Maxthon; .NET CLR 1.0.3705; .NET CLR 2.0.50727; .NET CLR 1.1.4322; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Maxthon; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 1.0.3705; .NET CLR 1.1.4322)
    • Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; xs-nwo59GiQ0mE; .NET CLR 2.0.50727; .NET CLR 1.1.4322)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 1.0.3705; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648; InfoPath.2)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; InfoPath.1; .NET CLR 3.0.04506.30; MS-RTC LM 8)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; ABCPlayer_1.3.19; ITVPlayer_1.3.22; .NET CLR 2.0.50727; .NET CLR 1.1.4322; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022; InfoPath.2)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; Mobivillage; .NET CLR 1.1.4322; .NET CLR 2.0.50727; Mobivillage; Mobivillage)
    • Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; SLCC1; .NET CLR 2.0.50727; .NET CLR 1.1.4322; .NET CLR 3.5.21022; .NET CLR 3.5.30729; .NET CLR 3.0.30729; OfficeLiveConnector.1.4; OfficeLivePatch.1.3; Creative AutoUpdate v1.10.10)
    • Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 5.1; .NET CLR 1.1.4322)
    • Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0)
    • Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 1.0.3705; InfoPath.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; MS-RTC LM 8)
    • Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727; InfoPath.1; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)
    • Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; GTB7.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729; .NET4.0C; .NET4.0E; OfficeLiveConnector.1.3; OfficeLivePatch.0.0)
    • Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; InfoPath.2; .NET CLR 2.0.50727; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)
    • Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; Sgrunt|V109|3060|S275053537|dialno; GTB6; InfoPath.1; .NET CLR 3.0.04506.30; .NET CLR 1.1.4322; .NET CLR 3.0.04506.648; OfficeLiveConnector.1.3; OfficeLivePatch.0.0; .NET CLR 2.0.50727; .NET
    • Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; WOW64; Trident/4.0; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; InfoPath.2)
    • Mozilla/4.0 (PSP (PlayStation Portable); 2.00)
    • Mozilla/4.1 (compatible; Symbian OS; Series 60) Teleca/Q7.0
    • Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)
    • Mozilla/5.0 (BREW; U; 3.1.5; en) AppleWebKit/528.28 (KHTML, like Gecko) OBIGO/W10.1 Safari/528.5 480X800 LGE VX11000
    • Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
    • Mozilla/5.0 (compatible; heritrix/1.14.0 +http://www.fscals.com)
    • Mozilla/5.0 (compatible; MSIE 7.0b; Windows NT 6.0)
    • Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; WOW64; Trident/5.0)
    • Mozilla/5.0 (en-us) AppleWebKit/525.13 (KHTML, like Gecko; Google Web Preview) Version/3.1 Safari/525.13
    • Mozilla/5.0 (en-us) AppleWebKit/525.13 (KHTML, like Gecko; Google Wireless Transcoder) Version/3.1 Safari/525.13
    • Mozilla/5.0 (iPhone; U; CPU iPhone OS 3_1_2 like Mac OS X; ko-kr) AppleWebKit/528.18 (KHTML, like Gecko) Version/4.0 Mobile/7D11 Safari/528.16
    • Mozilla/5.0 (Linux; U; Android 1.0; en-us; generic) AppleWebKit/525.10+ (KHTML, like Gecko) Version/3.0.4 Mobile Safari/523.12.2
    • Mozilla/5.0 (Linux; U; Android 2.3.3; ja-jp; sdk Build/GRI34) AppleWebKit/528.4 (KHTML, like Gecko) Safari/1.0
    • Mozilla/5.0 (Linux; U; Android 2.3.3; ja-jp; sdk Build/GRI34) AppleWebKit/533.1 (KHTML, like Gecko) TmmBrowser/1.0
    • Mozilla/5.0 (Linux; U; Android 2.3.5; en-us; SH-06D Build/DC200) AppleWebKit/534.23 (KHTML, like Gecko) Mobile TmmBrowser/1.0
    • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.0.7) Gecko/2009021906 Firefox/3.0.7
    • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1.1) Gecko/20090715 Firefox/3.5.1
    • Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.16) Gecko/20080702 Firefox/2.0.0.16
    • Mozilla/5.0 (Macintosh; U; Intel Mac OS X; sv-SE; rv:1.8.1.13) Gecko/20080311 Firefox/2.0.0.13
    • Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.4; en-US; rv:1.9.0.12) Gecko/2009070609 Firefox/3.0.12
    • Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/523.12.2 (KHTML, like Gecko) Version/3.0.4 Safari/523.12.2
    • Mozilla/5.0 (SymbianOS/9.1; U; en-us) AppleWebKit/413 (KHTML, like Gecko) Safari/413
    • Mozilla/5.0 (SymbianOS/9.1; U; en-us) AppleWebKit/413 (KHTML, like Gecko) Safari/413 es65
    • Mozilla/5.0 (SymbianOS/9.2; U; Series60/3.1 NokiaN95/11.0.026; Profile/MIDP-2.0 Configuration/CLDC-1.1 ) AppleWebKit/413 (KHTML, like Gecko) Safari/413
    • Mozilla/5.0 (Windows NT 5.1) AppleWebKit/534.27 (KHTML, like Gecko) Chrome/12.0.712.0 Safari/534.27
    • Mozilla/5.0 (Windows NT 5.1) AppleWebKit/534.30 (KHTML, like Gecko) Chrome/12.0.742.112 Safari/534.30
    • Mozilla/5.0 (Windows NT 5.1) AppleWebKit/534.30 (KHTML, like Gecko) Chrome/12.0.742.122 Safari/534.30
    • Mozilla/5.0 (Windows NT 5.1) AppleWebKit/535.1 (KHTML, like Gecko) Chrome/13.0.782.112 Safari/535.1
    • Mozilla/5.0 (Windows NT 5.1) AppleWebKit/535.1 (KHTML, like Gecko) Chrome/13.0.782.99 Safari/535.1
    • Mozilla/5.0 (Windows NT 5.1) AppleWebKit/535.2 (KHTML, like Gecko) Chrome/15.0.874.106 Safari/535.2
    • Mozilla/5.0 (Windows NT 5.1) AppleWebKit/535.2 (KHTML, like Gecko) Chrome/15.0.874.121 Safari/535.2
    • Mozilla/5.0 (Windows NT 5.1; rv:2.0.1) Gecko/20100101 Firefox/4.0.1
    • Mozilla/5.0 (Windows NT 5.1; rv:2.0b9) Gecko/20100101 Firefox/4.0b9
    • Mozilla/5.0 (Windows NT 6.1) AppleWebKit/535.7 (KHTML, like Gecko) Chrome/16.0.912.77 Safari/535.7
    • Mozilla/5.0 (Windows NT 6.1; rv:8.0) Gecko/20100101 Firefox/8.0
    • Mozilla/5.0 (Windows NT 6.1; rv:9.0.1) Gecko/20100101 Firefox/9.0.1
    • Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534+ (KHTML, like Gecko) BingPreview/1.0b
    • Mozilla/5.0 (Windows NT 6.1; WOW64; rv:10.0) Gecko/20100101 Firefox/10.0
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; da; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.2) Gecko/2008091620 Firefox/3.0.2 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.5) Gecko/2008120122 Firefox/3.0.5 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/528+ (KHTML, like Gecko) Version/3.1.2 Safari/525.21
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/530.5 (KHTML, like Gecko) Chrome/2.0.172.6 Safari/530.5
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/532.0 (KHTML, like Gecko) Chrome/3.0.195.27 Safari/532.0
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/532.5 (KHTML, like Gecko) Chrome/4.1.249.1064 Safari/532.5
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/534.10 (KHTML, like Gecko) Chrome/8.0.552.224 Safari/534.10
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/534.16 (KHTML, like Gecko) Chrome/10.0.648.205 Safari/534.16
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/534.7 (KHTML, like Gecko) Chrome/7.0.517.41 Safari/534.7
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.16) Gecko/20080702 Firefox/2.0.0.16
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.20) Gecko/20081217 Firefox/2.0.0.20
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.12) Gecko/2009070611 Firefox/3.0.12
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.15) Gecko/2009101601 Firefox/3.0.15 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.2) Gecko/2008091620 Firefox/3.0.2
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.4) Gecko/2008102920 Firefox/3.0.4
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.5) Gecko/2008120122 Firefox/3.0.5
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.6) Gecko/2009011913 Firefox/3.0.6
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.7) Gecko/2009021910 Firefox/3.0.7
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.9) Gecko/2009040821 Firefox/3.0.9 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1) Gecko/20090615 Firefox/3.5 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.3) Gecko/20090824 Firefox/3.5.3
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.10) Gecko/20100914 Firefox/3.6.10 ( .NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en; like Gecko) Obigo/Q7
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; es-ES; rv:1.9.0.6) Gecko/2009011913 Firefox/3.0.6
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; es-ES; rv:1.9.0.8) Gecko/2009032609 Firefox/3.0.8
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.9.1.7) Gecko/20091221 Firefox/3.5.7
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.9.2.12) Gecko/20101026 Firefox/3.6.12 ( .NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; ko; rv:1.9.2.16) Gecko/20110319 Firefox/3.6.16 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; rv:1.9.1.7) Gecko/20091221 Firefox/3.5.7 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-TW; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US) AppleWebKit/532.5 (KHTML, like Gecko) Chrome/4.1.249.1036 Safari/532.5
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.5) Gecko/2008120122 Firefox/3.0.5
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.6) Gecko/2009011913 Firefox/3.0.6
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.7) Gecko/2009021910 Firefox/3.0.4, Ant.com Toolbar 1.1
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.1) Gecko/20090715 Firefox/3.5.1 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1b4pre) Gecko/20090409 Shiretoko/3.5b4pre (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; it; rv:1.9.1.7) Gecko/20091221 Firefox/3.5.7 (.NET CLR 3.5.30729)
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; pl; rv:1.9.0.7) Gecko/2009021910 Firefox/3.0.7
    • Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.3) Gecko/20100401 Firefox/3.6.3 GTB7.0
    • Mozilla/5.0 (Windows; U; Windows NT 6.1; es-ES; rv:1.9.2.13) Gecko/20101203 Firefox/3.6.13
    • Mozilla/5.0 (X11; U; Linux armv6l; es-ES; rv:1.9a6pre) Gecko/20071128 Firefox/3.0a1 Tablet browser 0.2.2 RX-34+RX-44_2008SE_2.2007.50-2
    • Mozilla/5.0 (X11; U; Linux i686; en-US) AppleWebKit/534.13 (KHTML, like Gecko) Chrome/9.0.597.98 Safari/534.13
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.7) Gecko/20060909 Firefox/1.5.0.7 MG(Novarra-Vision/6.9)
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1) Gecko/20060601 Firefox/2.0 (Ubuntu-edgy)
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9) Gecko/2008060309 Firefox/3.0
    • Mozilla/5.0 (X11; U; Linux i686; en; rv:1.8.1.11) Gecko/20071204 Epiphany/2.20 Firefox/2.0.0.11
    • Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.7) Gecko/2009030503 Fedora/3.0.7-1.fc9 Firefox/3.0.7
    • NokiaN73-1/3.0704.1.0.1 Series60/3.0 Profile/MIDP-2.0 Configuration/CLDC-1.1
    • Opera/9.02 (Windows NT 5.0; U; en)
    • Opera/9.24 (X11; Linux i686; U; en)
    • Opera/9.50 (J2ME/MIDP; Opera Mini/4.0.9751/230; U; fr)
    • Opera/9.50 (J2ME/MIDP; Opera Mini/4.0.9800/230; U; en)
    • Opera/9.50 (Windows NT 5.1; U; en)
    • Opera/9.51 (Windows NT 5.1; U; en-GB)
    • Opera/9.60 (J2ME/MIDP; Opera Mini/4.0.8462/670; U; en) Presto/2.2.0
    • Opera/9.80 (J2ME/MIDP; Opera Mini/4.3.25172/25.677; U; en) Presto/2.5.25 Version/10.54
    • Opera/9.80 (Windows NT 5.1; U; en) Presto/2.6.37 Version/11.00
    • Opera/9.80 (Windows NT 5.1; U; ko) Presto/2.2.15 Version/10.10
    • Opera/9.80 (Windows NT 5.1; U; ko) Presto/2.5.24 Version/10.53
    • Opera/9.80 (Windows NT 5.1; U; ko) Presto/2.8.131 Version/11.11
    • Opera/9.80 (Windows NT 5.1; U; ko) Presto/2.9.168 Version/11.50
    • Opera/9.80 (Windows NT 5.1; U; zh-tw) Presto/2.9.168 Version/11.50
    • SAMSUNG-GT-M8800/M8800XXHIA SHP/VPP/R5 NetFront/3.5 Qtv5.3 SMM-MMS/1.2.0 profile/MIDP-2.1 configuration/CLDC-1.1
    • SAMSUNG-S8000/1.0 SHP/VPP/R5 Jasmine/1.0 Nextreaming SMM-MMS/1.2.0 profile/MIDP-2.1 configuration/CLDC-1.1
    • SAMSUNG-S8000/S8000XXHC1 SHP/VPP/R5 Jasmine/1.0 Nextreaming SMM-MMS/1.2.0 profile/MIDP-2.1 configuration/CLDC-1.1 SS-Widget/S8000-FM
    • SAMSUNG-SGH-T239/T239UVIA4 NetFront/3.4 Profile/MIDP-2.0 Configuration/CLDC-1.1
    • SAMSUNG-SGH-T349/T349UVIB3 NetFront/3.5 Profile/MIDP-2.0 Configuration/CLDC-1.1
    • SAMSUNG-SGH-T749/T749UVIC6 SHP/VPP/R5 NetFront/3.5 SMM-MMS/1.2.0 profile/MIDP-2.1 configuration/CLDC-1.1
    • SAMSUNG-SGH-T749/T749UVIF3 SHP/VPP/R5 NetFront/3.5 SMM-MMS/1.2.0 profile/MIDP-2.1 configuration/CLDC-1.1
    • SonyEricssonCS8/R1DA Browser/NetFront/3.4 Profile/MIDP-2.1 Configuration/CLDC-1.1 JavaPlatform/JP-8.4.1
    • SonyEricssonK800i/R1JG Browser/NetFront/3.3 Profile/MIDP-2.0 Configuration/CLDC-1.1
    • SonyEricssonK800i/R1KC Browser/NetFront/3.3 Profile/MIDP-2.0 Configuration/CLDC-1.1
    • Wget/1.10.2
    • Wget/1.10.2 (Red Hat modified)
    • Wget/1.11.3
    • Wget/1.11.4
    • Wget/1.11.4 Red Hat modified
    • Wget/1.12 (linux-gnu)
    • Yanga WorldSearch Bot v1.1/beta (http://www.yanga.co.uk/)
    • zibber-v0.1(www.zibb.com/crawler/)

    Tests list.