1 | 26975 | 52,47 | robots |
2 | 5868 | 11,41 | Googlebot/2.1 |
3 | 4943 | 9,62 | compatible Mozilla/5.0 |
4 | 4228 | 8,22 | Exabot/3.0 |
5 | 1535 | 2,99 | MJ12bot/v1.4.5 |
6 | 1452 | 2,82 | DotBot/1.1 |
7 | 990 | 1,93 | bingbot/2.0 |
8 | 916 | 1,78 | python-requests/2.2.1 CPython/2.7.3 Linu... |
9 | 443 | 0,86 | Yahoo! Slurp |
10 | 409 | 0,80 | SeznamBot/3.2-test4 |
11 | 356 | 0,69 | Twitterbot/1.0 |
12 | 332 | 0,65 | worldwebheritage.org/1.1 |
13 | 301 | 0,59 | msnbot/2.0b (+http://search.msn.com/msnb... |
14 | 234 | 0,46 | YandexBot/3.0 |
15 | 200 | 0,39 | ltx71 - (http://ltx71.com/) |
16 | 148 | 0,29 | GigablastOpenSource/1.0 |
17 | 137 | 0,27 | SeznamBot/3.2 |
18 | 131 | 0,25 | archive.org_bot |
19 | 122 | 0,24 | Java/1.6.0_26 |
20 | 121 | 0,24 | BUbiNG (+http://law.di.unimi.it/BUbiNG.h... |
21 | 119 | 0,23 | Kraken/0.1 |
22 | 108 | 0,21 | CCBot/2.0 (http://commoncrawl.org/faq/) |
23 | 96 | 0,19 | Stratagems Kumo |
24 | 84 | 0,16 | Y!J-ASR/0.1 crawler (http://www.yahoo-he... |
25 | 71 | 0,14 | tbot-nutch/Nutch-1.10 |
26 | 68 | 0,13 | BLEXBot/1.0 |
27 | 63 | 0,12 | SeznamBot/3.2-test1 |
28 | 59 | 0,11 | Sogou web spider/4.0(+http://www.sogou.c... |
29 | 53 | 0,10 | Chrome |
30 | 53 | 0,10 | MXT/Nutch-1.10 |