Robots |
1 | 1079 | 18.80 | MJ12bot/v1.4.8 |
2 | 880 | 15.34 | bingbot/2.0 |
3 | 872 | 15.20 | linkdexbot/2.0 |
4 | 568 | 9.90 | YandexBot/3.0 |
5 | 398 | 6.94 | Googlebot/2.1 |
6 | 367 | 6.40 | MJ12bot/v1.4.7 |
7 | 341 | 5.94 | SeznamBot/3.2 |
8 | 313 | 5.45 | compatible Mozilla/5.0 |
9 | 220 | 3.83 | AhrefsBot/5.2 |
10 | 126 | 2.20 | Cliqzbot/2.0 |
11 | 86 | 1.50 | DotBot/1.1 |
12 | 81 | 1.41 | Yahoo! Slurp |
13 | 73 | 1.27 | SemrushBot/1.2~bl |
14 | 36 | 0.63 | BUbiNG (+http://law.di.unimi.it/BUbiNG.h... |
15 | 33 | 0.58 | btcrawler |
16 | 32 | 0.56 | MBCrawler/1.0 (https://monitorbacklinks.... |
17 | 29 | 0.51 | CCBot/2.0 (http://commoncrawl.org/faq/) |
18 | 26 | 0.45 | Linux x86_64 |
19 | 22 | 0.38 | netEstate NE Crawler (+http://www.websit... |
20 | 18 | 0.31 | Pinterestbot/1.0 |
21 | 15 | 0.26 | ia_archiver |
22 | 15 | 0.26 | Barkrowler/0.7 (+http://www.exensa.com/c... |
23 | 9 | 0.16 | DeuSu/5.0.2 |
24 | 9 | 0.16 | MSIE 8.0 |
25 | 8 | 0.14 | spbot/5.0.3 |
26 | 8 | 0.14 | Sogou web spider/4.0(+http://www.sogou.c... |
27 | 8 | 0.14 | python-requests/2.12.5 |
28 | 8 | 0.14 | archive.org_bot |
29 | 7 | 0.12 | GrapeshotCrawler/2.0 |
30 | 4 | 0.07 | python-requests/2.18.4 |
31 | 4 | 0.07 | SEOkicks-Robot |
32 | 4 | 0.07 | MojeekBot/0.6 |
33 | 3 | 0.05 | MSIE 10.0 |
34 | 3 | 0.05 | Yeti/1.1 |
35 | 3 | 0.05 | MSIE 9.0 |
36 | 3 | 0.05 | Netscape 4.76 |
37 | 2 | 0.03 | Uptimebot/1.0 |
38 | 2 | 0.03 | SiteExplorer/1.1b |
39 | 2 | 0.03 | SeznamBot/3.2-test1-1 |
40 | 2 | 0.03 | MaxPointCrawler/Nutch-1.10 (maxpoint.cra... |
41 | 2 | 0.03 | linkdexbot/2.2 |
42 | 2 | 0.03 | - |
43 | 2 | 0.03 | ltx71 - (http://ltx71.com/) |
44 | 2 | 0.03 | MSIE 5.01 |
45 | 1 | 0.02 | ScoutJet |
46 | 1 | 0.02 | VSE/1.0 (mike@yippyinc.com) |
47 | 1 | 0.02 | Wotbox/2.01 (+http://www.wotbox.com/bot/... |
48 | 1 | 0.02 | StarhubBot/Nutch-1.10 |
49 | 1 | 0.02 | Contacts-Crawler/0.2 (+http://www.scrapi... |
50 | 1 | 0.02 | A6-Indexer |
51 | 1 | 0.02 | SafeDNSBot (https://www.safedns.com/sear... |
52 | 1 | 0.02 | ExtLinksBot/1.5 |
53 | 1 | 0.02 | GarlikCrawler/1.2 (http://garlik.com/, c... |
54 | 1 | 0.02 | adbeat_bot |
55 | 1 | 0.02 | Wget/1.13.4 (linux-gnu) |