Page MenuHomePhabricator

70.179.6.X is hammering xtools-articleinfo
Closed, ResolvedPublic

Description

Looks like it's scraping:

70.179.6.X - - [23/Dec/2015:17:15:26 +0000] "GET /wikiviewstats/?page=University_City%2C_San_Diego&latest=60&lang=en&wiki=wikipedia HTTP/1.1" 503 4024 "https://tools.wmflabs.org/xtools-articleinfo/?article=University_City,_San_Diego&project=en.wikipedia.org" "Mozilla/5.0 (Macintosh; Intel Mac OS X) AppleWebKit (KHTML, like Gecko)"
70.179.6.X - - [23/Dec/2015:17:15:28 +0000] "GET /xtools-articleinfo/?article=Encanto,_San_Diego&project=en.wikipedia.org&uselang=sw HTTP/1.1" 200 113636 "https://tools.wmflabs.org/xtools-articleinfo/?article=Encanto,_San_Diego&project=en.wikipedia.org" "Mozilla/5.0 (Macintosh; Intel Mac OS X) AppleWebKit (KHTML, like Gecko)"
70.179.6.X - - [23/Dec/2015:17:15:30 +0000] "GET /xtools/topedits/?user=Addbot&lang=en&wiki=wikipedia&page=Oak_Park%2C_San_Diego HTTP/1.1" 200 0 "https://tools.wmflabs.org/xtools-articleinfo/?article=Oak_Park,_San_Diego&project=en.wikipedia.org" "Mozilla/5.0 (Macintosh; Intel Mac OS X) AppleWebKit (KHTML, like Gecko)"
70.179.6.X - - [23/Dec/2015:17:15:33 +0000] "GET /xtools-articleinfo/?article=Template:University_of_California,_San_Diego&project=en.wikipedia.org&uselang=pi HTTP/1.1" 200 107800 "https://tools.wmflabs.org/xtools-articleinfo/?article=Template:University_of_California,_San_Diego&project=en.wikipedia.org" "Mozilla/5.0 (Macintosh; Intel Mac OS X) AppleWebKit (KHTML, like Gecko)"
70.179.6.X - - [23/Dec/2015:17:15:38 +0000] "GET /xtools-articleinfo/?article=Hillcrest,_San_Diego&project=en.wikipedia.org&uselang=nds-nl HTTP/1.1" 200 116271 "https://tools.wmflabs.org/xtools-articleinfo/?article=Hillcrest,_San_Diego&project=en.wikipedia.org" "Mozilla/5.0 (Macintosh; Intel Mac OS X) AppleWebKit (KHTML, like Gecko)"
70.179.6.X - - [23/Dec/2015:17:15:45 +0000] "GET /xtools-articleinfo/?article=Tijuana_River_Valley,_San_Diego&project=en.wikipedia.org&uselang=gu HTTP/1.1" 200 83300 "https://tools.wmflabs.org/xtools-articleinfo/?article=Tijuana_River_Valley,_San_Diego&project=en.wikipedia.org" "Mozilla/5.0 (Macintosh; Intel Mac OS X) AppleWebKit (KHTML, like Gecko)"
70.179.6.X - - [23/Dec/2015:17:15:46 +0000] "GET /xtools-articleinfo/?article=Category:Neighborhoods_in_San_Diego,_California&project=en.wikipedia.org&uselang=ti HTTP/1.1" 499 0 "https://tools.wmflabs.org/xtools-articleinfo/?article=Category:Neighborhoods_in_San_Diego,_California&project=en.wikipedia.org" "Mozilla/5.0 (Macintosh; Intel Mac OS X) AppleWebKit (KHTML, like Gecko)"
70.179.6.X - - [23/Dec/2015:17:15:46 +0000] "GET /xtools-articleinfo/?article=Stockton,_San_Diego&project=en.wikipedia.org&uselang=pfl HTTP/1.1" 499 0 "https://tools.wmflabs.org/xtools-articleinfo/?article=Stockton,_San_Diego&project=en.wikipedia.org" "Mozilla/5.0 (Macintosh; Intel Mac OS X) AppleWebKit (KHTML, like Gecko)"
70.179.6.X - - [23/Dec/2015:17:15:50 +0000] "GET /xtools/oauthredirector.php?action=login&callto=https://en.wikipedia.org/w/api.php&returnto=https://tools.wmflabs.org/xtools-articleinfo/?article=Category:University_of_California,_San_Diego&project=en.wikipedia.org&uselang=inh HTTP/1.1" 302 0 "https://tools.wmflabs.org/xtools-articleinfo/?article=Category:University_of_California,_San_Diego&project=en.wikipedia.org&uselang=inh" "Mozilla/5.0 (Macintosh; Intel Mac OS X) AppleWebKit (KHTML, like Gecko)"
70.179.6.X - - [23/Dec/2015:17:15:51 +0000] "GET /xtools-articleinfo/?article=Bay_Terraces,_San_Diego&project=en.wikipedia.org&uselang=af HTTP/1.1" 499 0 "https://tools.wmflabs.org/xtools-articleinfo/?article=Bay_Terraces,_San_Diego&project=en.wikipedia.org" "Mozilla/5.0 (Macintosh; Intel Mac OS X) AppleWebKit (KHTML, like Gecko)"

I'm working on blocking this on the nginx level with a pretty 403.

Event Timeline

valhallasw raised the priority of this task from to Needs Triage.
valhallasw updated the task description. (Show Details)
valhallasw added a project: Toolforge.
valhallasw added a subscriber: valhallasw.
Restricted Application added a project: Cloud-Services. · View Herald TranscriptDec 23 2015, 5:17 PM
Restricted Application added subscribers: StudiesWorld, Aklapper. · View Herald Transcript

Change 260768 had a related patch set uploaded (by Merlijn van Deen):
dynamicproxy: make banning users easier

https://gerrit.wikimedia.org/r/260768