User Agent | Number of hits | Data Transferred (Kb) |
The Knowledge AI | 541 | 335 |
ltx71 - (http://ltx71.com/) | 426 | 898 |
facebookexternalhit/1.1 ( http://www.facebook.com/externalhit_uatext.php) | 317 | 17,080 |
WikiDo/1.1 (http://wikido.com; crawler@wikido.com) | 240 | 1,184 |
CCBot/2.0 (https://commoncrawl.org/faq/) | 158 | 470 |
python-requests/2.24.0 | 142 | 172 |
netEstate NE Crawler ( http://www.website-datenbank.de/) | 142 | 365 |
YelpBot (https://www.yelp.com/) | 141 | 665 |
lua-resty-http/0.10 (Lua) ngx_lua/10000 | 134 | 582 |
SetCronJob/1.0 ( http://www.setcronjob.com/) | 123 | 61 |
lua-resty-http/0.07 (Lua) ngx_lua/10000 | 94 | 401 |
python-requests/2.25.1 | 82 | 90 |
Dispatch/0.14.0-SNAPSHOT | 47 | 680 |
N/A | 47 | 1,807 |
panscient.com | 45 | 74 |
DF Bot 1.0 | 39 | 426 |
python-requests/2.25.0 | 35 | 77 |
Internet Explorer 5.01 | 33 | 1,711 |
Python-urllib/2.7 | 29 | 45 |
HubSpot Connect 2.0 (http://dev.hubspot.com/) - BizOpsCompanies-Tq2-BizCoDomainValidationAudit | 28 | 8 |
curl/7.68.0 | 28 | 14 |
YahooCacheSystem; YahooWebServiceClient | 23 | 1,045 |
python-requests/2.23.0 | 21 | 18 |
YahooMailProxy; https://help.yahoo.com/kb/yahoo-mail-proxy-SLN28749.html | 17 | 173 |
OmniWeb 622.6.1.0.111015 | 16 | 293 |
cortex/1.0 | 13 | 1,796 |
python-requests/2.22.0 | 12 | 24 |
python-requests/2.9.1 | 12 | 5 |
Flock 0.7.14 | 11 | 56 |
Links (2.1pre17; Linux 2.6.12.2 i686; x) | 11 | 55 |
SafeDNSBot (https://www.safedns.com/searchbot) | 11 | 60 |
adreview/1.0 | 9 | 1,284 |
Photon/1.0 | 8 | 2,177 |
curl/7.38.0 | 8 | 253 |
DuckDuckBot/1.1; ( http://duckduckgo.com/duckduckbot.html) | 8 | 539 |
Ruby | 6 | 28 |
Python-urllib/3.7 | 6 | 16 |
ReactorNetty/0.7.10.RELEASE | 6 | 35 |
Go-http-client/1.1 | 6 | 1,266 |
AccompanyBot | 6 | 28 |
Others | 84 | 1,761 |
Total | 3,165 | 38,057 |