Page MenuHomePhabricator

new_top200_newly_found_bots.csv

Authored By
JAllemandou
Sep 9 2015, 1:46 PM
Size
17 KB
Referenced Files
None
Subscribers
None

new_top200_newly_found_bots.csv

user_agent device_family is_bot_regexp is_crawler_regexp is_bwest_regexp c
- Other false false true 2560464
Peachy MediaWiki Bot API Version 2.0 (alpha 8) Other true false true 386762
Java/1.8.0_51 Other false false true 158011
Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 (KHTML, like Gecko) Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; http://www.bing.com/bingbot.htm) iPhone true false true 153654
AppleDictionaryService/229 Other false false true 136959
python-requests/2.7.0 CPython/3.4.2 Linux/3.16.0-4-amd64 Other false false true 126322
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php) Other false false true 114900
AppleDictionaryService/229.1 Other false false true 112437
Java/1.8.0_25 Other false false true 94925
DotNetWikiBot/2.101 (Microsoft Windows NT 6.2.9200.0; .NET CLR 4.0.30319.34209) Other true false true 78382
Java/1.8.0_40 Other false false true 64571
Java/1.6.0_20 Other false false true 64556
Java/1.8.0_45 Other false false true 62808
Python-urllib/2.7 Other false false true 60616
Java/1.7.0_67 Other false false true 56348
Java/1.7.0_79 Other false false true 54573
RBot/0.3 (underdog@wolfhome.com) Other true false true 51205
Java/1.7.0_65 Other false false true 46803
TaxonBot@de.wikipedia <animalia@gmx.net> – MediaWiki Tcl Bot Framework 0.5 Other true false true 45491
AppleDictionaryService/208 Other false false true 43856
ClueBot/1.1 Other true false true 43516
Mozilla/5.0 (MyMemory Bot http://mymemory.traslated.net/doc/) Other true false true 40882
crawler4j (https://github.com/yasserg/crawler4j/) Generic Feature Phone false true false 32015
Python-urllib/2.6 Other false false true 28479
curl/7.35.0 Other false false true 26310
WordPress/4.2.4; http://rideon.ajslandscapingsvc.com Other false false true 23947
Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Trident/5.0); 360Spider(compatible; HaosouSpider; http://www.haosou.com/help/help_3_2.html) Other false false true 23216
SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html) Samsung SGH-E250 true false true 22678
Python-urllib/1.17 Other false false true 21932
Java/1.7.0_71 Other false false true 20770
AnonyMousBot V1.0-Beta Anonymous-browser.com Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 1.1.4322) Motorola true false true 18212
Mozilla/5.0 (compatible; Gluten Free Crawler/1.0; +http://glutenfreepleasure.com/) Other false true false 17981
python-requests/2.7.0 CPython/2.7.6 Linux/3.13.0-54-generic Other false false true 17708
AppleDictionaryService/131.2 Other false false true 17475
AniBot/0.9 php/curl Other true false true 17404
Java/1.7.0_21 Other false false true 15454
Mozilla/5.0 (iPhone; CPU iPhone OS 8_4_1 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Mobile/12H321 YJApp-IOS jp.co.yahoo.ipn.appli/4.2.1 iPhone false false true 15208
AppleDictionaryService/184.4 Other false false true 15130
WordPress/4.2.4; http://lpn.wreckthenation.com Other false false true 14028
ClueBot/2.0 Other true false true 13261
Facebook Wikipedia Fetcher v0.1 Other false false true 13225
ZumBot/1.0 (ZUM Search; http://help.zum.com/inquiry) Other true false true 13036
AppleDictionaryService/158.3 Other false false true 11667
Mozilla/5.0 (compatible; MagiBot/1.0.5; +http://magi.peak-labs.com) Other true false true 11212
MwBot Other true false true 11028
WordPress/4.2.4; http://daybed.thegatheringhome.org Other false false true 10689
WordPress/4.2.4; http://cooking.wearedavinci.com Other false false true 10568
Google-HTTP-Java-Client/1.17.0-rc (gzip) Other false false true 9958
Java/1.7.0_45 Other false false true 9950
Mozilla/5.0 (compatible; DuckDuckGo-Favicons-Bot/1.0; +http://duckduckgo.com) Other true false true 9775
compat-redirect.py/rs11211 Pywikipediabot/1.0 Xqbot Generic Feature Phone true false true 9296
python-requests/2.3.0 CPython/3.4.2 Linux/3.10.42-52.145.amzn1.x86_64 Other false false true 8869
AnomieBOT/1.0 (TagDater; see [[User:AnomieBOT]]) Other true false false 8720
python-requests/2.2.1 CPython/3.4.0 Linux/3.13.0-46-generic Other false false true 8128
Hoo Bot (+https://meta.wikimedia.org/wiki/User:Hoo_man) Other true false true 7935
python-requests/2.5.3 CPython/3.4.0 Linux/3.13.0-45-generic Other false false true 7524
Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/21.0.1180.89 Safari/537.1; 360Spider(compatible; HaosouSpider; http://www.haosou.com/help/help_3_2.html) Other false false true 7197
WordPress/4.2.4; http://cna.americaneskimodogrescue.com Other false false true 7186
Python-urllib/3.4 Other false false true 6946
Java/1.8.0_31 Other false false true 6770
curl/7.26.0 Other false false true 5118
DotNetWikiBot/3.14 (Microsoft Windows NT 6.2.9200.0; .NET CLR 4.0.30319.42000) Other true false true 4872
WordPress/4.2.4; http://communitycollege.t1wetsuits.com Other false false true 4529
Mozilla/5.0 (compatible; yoozBot-2.2; http://yooz.ir; info@yooz.ir) Other true false true 4503
WordPress/4.2.4; http://nursing.apollobgshospitals.org Other false false true 4457
WordPress/4.2.4; http://medical.nftkd.com Other false false true 4388
WordPress/4.2.4; http://cnatraining.work Other false false true 4223
curl/7.22.0 (x86_64-pc-linux-gnu) libcurl/7.22.0 OpenSSL/1.0.1 zlib/1.2.3.4 libidn/1.23 librtmp/2.3 Other false false true 4108
Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Trident/5.0); 360Spider Other false false true 4009
AppleDictionaryService/250 Other false false true 3960
MediaWiki::Bot/3.005002 Other true false true 3588
python-requests/2.2.1 CPython/2.7.6 Linux/3.13.0-61-generic Other false false true 3566
curl/7.38.0 Other false false true 3504
WorldOfMusicBetaBot/1.0 Other true false true 3466
AppEngine-Google; (+http://code.google.com/appengine; appid: s~wikien4-hrd) Other false false true 3394
AppEngine-Google; (+http://code.google.com/appengine; appid: s~wikien3-hrd) Other false false true 3252
Yahoo Pipes 2.0 Other false false true 3235
Mozilla/5.0 (iPhone; CPU iPhone OS 8_4 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Mobile/12H143 YJApp-IOS jp.co.yahoo.ipn.appli/4.2.1 iPhone false false true 3216
AnomieBOT/1.0 (OrphanReferenceFixer; see [[User:AnomieBOT]]) Other true false false 3068
YahooCacheSystem Other false false true 3029
WordPress/4.2.4; http://hvac-school.tech-solution.net Other false false true 2976
python-requests/2.5.1 CPython/2.6.6 Linux/2.6.32-504.el6.x86_64 Other false false true 2970
DotNetWikiBot/3.11 (Microsoft Windows NT 6.2.9200.0; .NET CLR 2.0.50727.8009) Other true false true 2917
AppEngine-Google; (+http://code.google.com/appengine; appid: s~ortografia4-hrd) Other false false true 2909
Java/1.8.0_05 Other false false true 2873
GermCrawler Other false true false 2832
WikiBot/0.1 AppEngine-Google; (+http://code.google.com/appengine; appid: s~newnewwikipedia) Other true false true 2694
Mozilla/5.0 (iPhone; CPU iPhone OS 8_1 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Version/8.0 Mobile/12B411 Safari/600.1.4 (compatible; YandexBot/3.0; +http://yandex.com/bots) iPhone true false true 2646
AnomieBOT/1.0 (DeletionSortingCleaner; see [[User:AnomieBOT]]) Other true false false 2631
PythonWikipediaBot/1.0 Other true false true 2594
Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 (KHTML, like Gecko) Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) iPhone true false true 2567
WordPress/4.3; http://elvisthetruekingofrock.com Other false false true 2546
Java/1.7.0_75 Other false false true 2534
DotNetWikiBot/3.14 (Unix 3.18.11.0; Mono 3.2.8; .NET CLR 2.0.50727.1433) Other true false true 2469
python-requests/2.7.0 CPython/2.7.10 Linux/3.13.0-24-generic Other false false true 2409
Mozilla/5.0 (iPhone; CPU iPhone OS 8_3 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Mobile/12F70 YJApp-IOS jp.co.yahoo.ipn.appli/4.2.1 iPhone false false true 2390
python-requests/2.5.1 CPython/2.7.8 Linux/3.13.0-43-generic Other false false true 2276
Mozzila/5.0 (Windows NT 5.1; GulliwayBot/01 +http://gulliway.org) Other true false true 2272
curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 OpenSSL/1.0.1j zlib/1.2.3 libidn/0.6.5 Other false false true 2250
Java/1.6.0_101 Other false false true 2216
WordPress/4.2.4; http://nursingschoolsprograms.net Other false false true 2210
WordPress/4.3; http://explorecalifornia.news Other false false true 2101
WordPress/4.2.4; http://www.naturalbreast.xyz Other false false true 2097
curl/7.36.0 Other false false true 1986
Mozilla/5.0 (iPad; CPU OS 8_4_1 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Mobile/12H321 YJApp-IOS jp.co.yahoo.ipn.appli/4.2.1 iPad false false true 1970
curl/7.29.0 Other false false true 1943
python-requests/2.3.0 CPython/2.7.3 Linux/3.2.0-60-virtual Other false false true 1905
MyBot/1.0 (http://tanglish.onlinejini.com) Other true false true 1890
curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 OpenSSL/1.0.1h zlib/1.2.3 libidn/0.6.5 Other false false true 1792
SineBot/1.5.19(User:SineBot) Other true false true 1792
MyBot/1.0 (abala.jini@gmail.com) Other true false true 1768
WordPress.com; https://wittevlinders.wordpress.com Other false false true 1732
WordPress/4.2.4; http://www.reisestationen.de Other false false true 1700
AppEngine-Google; (+http://code.google.com/appengine; appid: s~449-lsw3) Other false false true 1628
AppEngine-Google; (+http://code.google.com/appengine; appid: s~surf6009-hrd) Other false false true 1627
Java/1.8.0_20 Other false false true 1603
RSS Bot/2.0 (Mac OS X Version 10.10.5 (Build 14F27)) Other true false true 1586
AppEngine-Google; (+http://code.google.com/appengine; appid: s~no8lancelot) Other false false true 1553
UKBot [[:no:Bruker:UKBot]] - MwClient/0.8.0.dev1 (https://github.com/mwclient/mwclient) Other true false true 1488
compat-interwiki.py/r-1 (unknown) Pywikipediabot/1.0 Generic Feature Phone true false true 1471
Mozilla/5.0 (compatible; gazBot) Other true false true 1440
python-requests/2.5.0 CPython/2.7.6 Linux/3.13.0-44-generic Other false false true 1402
RockPeaks/0.1 (+http://www.rockpeaks.com/contact) Other false false true 1379
AnomieBOT/1.0 (PERTableUpdater; see [[User:AnomieBOT]]) Generic Smartphone true false false 1287
MoodleBot/1.0 Other true false true 1205
AnomieBOT/1.0 (TemplateSubster; see [[User:AnomieBOT]]) Other true false false 1191
python-requests/2.0.0 CPython/2.7.3 Linux/3.2.0-75-virtual Other false false true 1190
curl/7.44.0 Other false false true 1121
AppEngine-Google; (+http://code.google.com/appengine; appid: s~biologicallyspeaking) Other false false true 1086
WordPress/4.2.4; http://tradeschool.emersoneast.org Other false false true 1072
Mozilla/5.0 (iPhone; CPU iPhone OS 7_1_2 like Mac OS X) AppleWebKit/537.51.2 (KHTML, like Gecko) Mobile/11D257 YJApp-IOS jp.co.yahoo.ipn.appli/4.2.1 iPhone false false true 1058
WordPress/4.2.4; http://refrigerators.annuaire-decoration.info Other false false true 1054
python-requests/2.6.0 CPython/2.7.3 Linux/3.13.0-61-generic Other false false true 1047
curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.14.0.0 zlib/1.2.3 libidn/1.18 libssh2/1.4.2 Other false false true 1036
crawler4j (http://code.google.com/p/crawler4j/) Generic Feature Phone false true false 1013
AppEngine-Google; (+http://code.google.com/appengine; appid: s~win8wale) Other false false true 1010
Webwiki Search Engine Bot - www.webwiki.de Other true false true 974
DotNetWikiBot/3.14 (Microsoft Windows NT 6.1.7601 Service Pack 1; .NET CLR 4.0.30319.34209) Other true false true 952
WordPress/4.2.2; http://holidayinnpanama.com Other false false true 922
Mozilla/5.0 (iPhone; CPU iPhone OS 7_1 like Mac OS X) AppleWebKit (KHTML, like Gecko) Mobile (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) iPhone false false true 910
python-requests/2.7.0 CPython/2.7.3 Linux/3.2.0-4-amd64 Other false false true 903
MyBot/1.0 (http://www.mp4viddownload.com/) Other true false true 885
Mozilla/5.0 (Linux; U; Android 4.2.2; ja-jp; SO-04E Build/10.3.1.B.2.42) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30 YJApp-ANDROID jp.co.yahoo.android.yjtop/3.0.21 SO-04E false false true 865
WordPress/4.3; http://honorari.com Other false false true 863
COIBot/1.00 Other true false true 855
AppEngine-Google; (+http://code.google.com/appengine; appid: s~223-p1) Other false false true 849
Mozilla/5.0 (Linux; Android 4.4.4; SO-02G Build/23.0.B.1.59) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/33.0.0.0 Mobile Safari/537.36 YJApp-ANDROID jp.co.yahoo.android.yjtop/3.0.21 SO-02G false false true 828
curl () libcurl/ zlib/ <webmarketing@bssivirtual.com> Motorola false false true 828
MyBot/1.0 (http://www.mp4musicsong.com/) Other true false true 819
AppEngine-Google; (+http://code.google.com/appengine; appid: s~ortopedianew-hrd) Other false false true 806
curl/7.30.0 Other false false true 804
YandexExtdataBot/1.0 (extdata@yandex-team.com) Other true false true 792
WordPress/4.2.4; http://fiberglasspoolss.com Other false false true 788
WordPress/4.2.4; http://destinosa1.com Other false false true 774
Java/1.7.0_80 Other false false true 774
Java/1.6.0_26 Other false false true 760
Java/1.6.0_30 Other false false true 726
WordPress/4.3; http://www.bel7infos.eu Other false false true 706
curl/7.43.0 Other false false true 702
Mozilla/5.0 (iPhone; CPU iPhone OS 8_1_2 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Mobile/12B440 YJApp-IOS jp.co.yahoo.ipn.appli/4.2.1 iPhone false false true 696
DotNetWikiBot/3.0 (Microsoft Windows NT 6.1.7601 Service Pack 1; .NET CLR 4.0.30319.34209) Other true false true 695
Java/1.7.0_60 Other false false true 686
Mozilla/5.0 (iPhone; CPU iPhone OS 8_2 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Mobile/12D508 YJApp-IOS jp.co.yahoo.ipn.appli/4.2.1 iPhone false false true 684
DotNetWikiBot/3.14 (Microsoft Windows NT 6.1.7601 Service Pack 1; .NET CLR 2.0.50727.5485) Other true false true 650
Mozilla/5.0 (iPhone; CPU iPhone OS 8_1_3 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Mobile/12B466 YJApp-IOS jp.co.yahoo.ipn.appli/4.2.1 iPhone false false true 648
Beagle Crawler 0.1 Other false true false 645
MediaWiki::Bot/3.2.6 Other true false true 624
WordPress/4.2.4; http://college.t1wetsuits.com Other false false true 619
Mozilla/5.0 (Linux; Android 4.4.2; GLX SpiderI Build/KOT49H) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/30.0.0.0 Mobile Safari/537.36 GLX SpiderI false false true 599
Python-urllib/2.1 Other false false true 596
compat-basicdeadlinkslist.py/rg11235 Pywikipediabot/1.0 Generic Feature Phone true false true 593
Mozilla/5.0 (iPhone; CPU iPhone OS 8_1 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Mobile/12B411 YJApp-IOS jp.co.yahoo.ipn.appli/4.2.1 iPhone false false true 573
curl 7.24.0 (x86_64-unknown-linux-gnu) libcurl/7.24.0 OpenSSL/1.0.0 zlib/1.2.3 <townlogs@townlogs.com> Other false false true 570
python-requests/1.2.3 CPython/2.7.3 Linux/3.2.0-24-virtual Other false false true 559
WordPress/4.1.7; http://nswai.com Other false false true 543
WordPress/4.0; http://soycarters.com/answers Other false false true 539
AppEngine-Google; (+http://code.google.com/appengine; appid: s~nyinayminproxy9) Other false false true 536
http://tools.wmflabs.org/languagetool/ bot, contact: naber[@]danielnaber.de Generic Feature Phone true false true 533
MyCuteBot/0.1 Other true false true 506
Peachy MediaWiki Bot API Version 1.0 Other true false true 500
Python-urllib/2.5 AppEngine-Google; (+http://code.google.com/appengine; appid: s~isnt-it) Other false false true 500
python-requests/2.7.0 CPython/2.7.6 Linux/2.6.32-504.3.3.el6.x86_64 Other false false true 498
WordPress/4.3; http://janmoffitt.com/travel Other false false true 492
Mozilla/5.0 (Linux; Android 4.4.2; 302KC Build/102.0.2e00) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/30.0.0.0 Mobile Safari/537.36 YJApp-ANDROID jp.co.yahoo.android.ybrowser/1.7.23 302KC false false true 485
curl/7.37.1 Other false false true 482
WordPress.com; http://totalcrime.co.uk Other false false true 477
Mozilla/5.0 (Linux; Android 5.0; SC-04F Build/LRX21T; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/44.0.2403.117 Mobile Safari/537.36 YJApp-ANDROID jp.co.yahoo.android.yjtop/3.0.21 SC-04F false false true 471
Java Bot (https://github/vlsergey/Secretary; vlsergey@gmail.com) BasedOnJWBF Other true false true 466
Mozilla/5.0 (Linux; U; Android 4.2.2; de-de; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30 CUBOT P9 true false false 465
CaBot Other true false true 464
AppEngine-Google; (+http://code.google.com/appengine; appid: s~map-of-life) Other false false true 460
python-requests/2.2.1 CPython/2.7.9 Linux/3.14.32-xxxx-grs-ipv6-64 Other false false true 454
python-requests/2.0.1 CPython/2.7.4 Linux/3.13.0-62-generic Other false false true 452
Mozilla/5.0 (Linux; Android 4.4.2; 302KC Build/102.0.2e00) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/30.0.0.0 Mobile Safari/537.36 YJApp-ANDROID jp.co.yahoo.android.yjtop/3.0.21 302KC false false true 452
Mozilla/5.0 (Linux; Android 4.4.2; SC-04E Build/KOT49H) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/30.0.0.0 Mobile Safari/537.36 YJApp-ANDROID jp.co.yahoo.android.yjtop/3.0.21 SC-04E false false true 447
Java/1.6.0_35 Other false false true 443
COIBot/2.0 Other true false true 439
WordPress.com; http://stevereads.com Other false false true 439
WordPress/4.2.4; http://www.mushroom-magazine.com Other false false true 438
Mozilla/5.0 MaboMwFramework/1.3 (w:de:MerlBot) Other true false true 437

File Metadata

Mime Type
text/plain
Storage Engine
blob
Storage Format
Raw Data
Storage Handle
2575064
Default Alt Text
new_top200_newly_found_bots.csv (17 KB)

Event Timeline