1 | 4076 | 29,87 | msnbot-media/1.1 (+http://search.msn.com... |
2 | 2626 | 19,24 | compatible Mozilla/5.0 |
3 | 2222 | 16,28 | MJ12bot/v1.4.4 |
4 | 761 | 5,58 | SeznamBot/3.0 (+http://fulltext.sblog.cz... |
5 | 684 | 5,01 | Ezooms/1.0 |
6 | 658 | 4,82 | CB/Nutch-1.7 |
7 | 293 | 2,15 | bingbot/2.0 |
8 | 221 | 1,62 | Yahoo! Slurp |
9 | 218 | 1,60 | Java/1.6.0_24 |
10 | 184 | 1,35 | python-requests/1.2.3 CPython/2.7.3 Linu... |
11 | 169 | 1,24 | Java/1.6.0_26 |
12 | 132 | 0,97 | crawler4j (http://code.google.com/p/craw... |
13 | 105 | 0,77 | Kraken/0.1 |
14 | 103 | 0,75 | ExB Language Crawler 2.1.5 (+http://www.... |
15 | 88 | 0,64 | proximic |
16 | 84 | 0,62 | MSIE 8.0 |
17 | 75 | 0,55 | YandexBot/3.0 |
18 | 75 | 0,55 | Googlebot/2.1 |
19 | 70 | 0,51 | Baiduspider/2.0 |
20 | 59 | 0,43 | msnbot/2.0b (+http://search.msn.com/msnb... |
21 | 53 | 0,39 | SEOENGWorldBot/1.0 (+http://www.seoengin... |
22 | 53 | 0,39 | MJ12bot/v1.4.3 |
23 | 46 | 0,34 | R6_CommentReader(www.radian6.com/crawler... |
24 | 44 | 0,32 | GrapeshotCrawler/2.0 |
25 | 43 | 0,32 | Sogou web spider/4.0 |
26 | 42 | 0,31 | MojeekBot/0.5 |
27 | 28 | 0,21 | Exabot/3.0 |
28 | 28 | 0,21 | Sogou web spider/4.0(+http://www.sogou.c... |
29 | 25 | 0,18 | www.integromedb.org/Crawler |
30 | 24 | 0,18 | Linux x86_64 |