Robots |
1 | 4364 | 51.86 | bingbot/2.0 |
2 | 759 | 9.02 | Ezooms/1.0 |
3 | 704 | 8.37 | MJ12bot/v1.4.4 |
4 | 678 | 8.06 | linkdexbot/2.0 |
5 | 419 | 4.98 | Googlebot/2.1 |
6 | 368 | 4.37 | compatible Mozilla/5.0 |
7 | 294 | 3.49 | URLAppendBot/1.0 |
8 | 199 | 2.36 | Linux x86_64 |
9 | 157 | 1.87 | msnbot-media/1.1 (+http://search.msn.com... |
10 | 125 | 1.49 | msnbot/2.0b (+http://search.msn.com/msnb... |
11 | 97 | 1.15 | YandexBot/3.0 |
12 | 32 | 0.38 | coccoc/1.0 |
13 | 26 | 0.31 | EasouSpider |
14 | 17 | 0.20 | SeznamBot/3.0 (+http://fulltext.sblog.cz... |
15 | 16 | 0.19 | archive.org_bot |
16 | 14 | 0.17 | YandexImages/3.0 |
17 | 13 | 0.15 | MSIE 9.0 |
18 | 13 | 0.15 | SiteExplorer/1.0b |
19 | 11 | 0.13 | Baiduspider/2.0 |
20 | 10 | 0.12 | MSIE 8.0 |
21 | 8 | 0.10 | Python-urllib/2.6 |
22 | 7 | 0.08 | nutch-1.4/Nutch-1.4 |
23 | 6 | 0.07 | SISTRIX Crawler |
24 | 6 | 0.07 | A6-Indexer/1.0 (http://www.a6corp.com/a6... |
25 | 6 | 0.07 | - |
26 | 6 | 0.07 | GrapeshotCrawler/2.0 |
27 | 5 | 0.06 | Exabot/3.0 |
28 | 4 | 0.05 | Yahoo! Slurp |
29 | 4 | 0.05 | Sogou web spider/4.0(+http://www.sogou.c... |
30 | 4 | 0.05 | Exabot/3.0 (BiggerBetter) |
31 | 4 | 0.05 | meanpathbot/1.0 |
32 | 4 | 0.05 | genealogyofnewengland.com |
33 | 3 | 0.04 | Cliqzbot |
34 | 3 | 0.04 | proximic |
35 | 2 | 0.02 | TurnitinBot/3.0 (http://www.turnitin.com... |
36 | 2 | 0.02 | SemrushBot/0.97 |
37 | 2 | 0.02 | Python-urllib/2.7 |
38 | 2 | 0.02 | WeSEE:Search/0.1 (Alpha, http://www.wese... |
39 | 2 | 0.02 | MSIE 6.0 |
40 | 2 | 0.02 | MaxPointCrawler/Nutch-1.1 (maxpoint.craw... |
41 | 2 | 0.02 | CompSpyBot/1.0 |
42 | 2 | 0.02 | spbot/4.0.6 |
43 | 2 | 0.02 | MSIE 5.01 |
44 | 1 | 0.01 | compatible Mozilla/4.0 |
45 | 1 | 0.01 | Wotbox/2.01 (+http://www.wotbox.com/bot/... |
46 | 1 | 0.01 | SiteTruth.com site rating system |
47 | 1 | 0.01 | Blekkobot |
48 | 1 | 0.01 | AdnormCrawler www.adnorm.com/crawler |
49 | 1 | 0.01 | spbot/4.0.5 |
50 | 1 | 0.01 | WeSEE:Search |
51 | 1 | 0.01 | NetSeer crawler/2.0 |
52 | 1 | 0.01 | PagesInventory (robot http://www.pagesin... |
53 | 1 | 0.01 | Cliqzbot/0.1 (+http://cliqz.com/company/... |
54 | 1 | 0.01 | Aboundex/0.2 (http://www.aboundex.com/cr... |