Page MenuHomePhabricator
Create Task
Maniphest T122327

Block xtools-articleinfo from scrapers
Closed, ResolvedPublic
Actions

Description

The large amount of uselang= urls also cause benign scrapers to load the same page over and over again. See also T122307: 70.179.6.X is hammering xtools-articleinfo.

Details

SubjectRepoBranchLines +/-
Block xtools-articleinfo from scraperslabs/toollabsmaster+3 -0
Customize query in gerrit

Related Objects

Event Timeline

valhallasw created this task.Dec 23 2015, 7:29 PM
valhallasw raised the priority of this task from to Needs Triage.
valhallasw updated the task description. (Show Details)
valhallasw added a project: Toolforge.
valhallasw subscribed.
Restricted Application added a project: Cloud-Services. · View Herald TranscriptDec 23 2015, 7:29 PM
Restricted Application added subscribers: StudiesWorld, Aklapper. · View Herald Transcript
gerritbot subscribed.May 27 2016, 12:27 PM

Change 291214 had a related patch set uploaded (by Merlijn van Deen):
Block xtools-articleinfo from scrapers

https://gerrit.wikimedia.org/r/291214

gerritbot added a project: Patch-For-Review.May 27 2016, 12:27 PM
valhallasw triaged this task as Low priority.May 27 2016, 1:09 PM
valhallasw moved this task from Backlog to Waiting for code review on the Toolforge board.
gerritbot added a comment.May 27 2016, 2:27 PM

Change 291214 merged by jenkins-bot:
Block xtools-articleinfo from scrapers

https://gerrit.wikimedia.org/r/291214

scfc closed this task as Resolved.Nov 26 2016, 11:29 PM
scfc assigned this task to valhallasw.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL