Page MenuHomePhabricator

Add entries to robots.txt to block RFA/RFC/RFAR
Closed, DeclinedPublic

Description

Author: bugzilla

Description:
please add the following lines to http://en.wikipedia.org/robots.txt under
"User-agent: *"

Disallow: /wiki/Wikipedia:Requests_for_arbitration/
Disallow: /wiki/Wikipedia%3ARequests_for_arbitration/
Disallow: /wiki/Wikipedia:Requests_for_comment/
Disallow: /wiki/Wikipedia%3ARequests_for_comment/
Disallow: /wiki/Wikipedia:Requests_for_adminship/
Disallow: /wiki/Wikipedia%3ARequests_for_adminship/


Version: unspecified
Severity: normal
URL: http://en.wikipedia.org/robots.txt

Details

Reference
bz11261

Event Timeline

bzimport raised the priority of this task from to Lowest.Nov 21 2014, 9:54 PM
bzimport set Reference to bz11261.
bzimport added a subscriber: Unknown Object (MLST).

/me points to the similar bug 6746 (robots.txt), a year and 2 months ago.

stephen.bain wrote:

This works to disallow indexing of the project space pages, but not their associated talk pages. Can someone also add the following lines:

Disallow: /wiki/Wikipedia_talk:Requests_for_arbitration/
Disallow: /wiki/Wikipedia_talk%3ARequests_for_arbitration/
Disallow: /wiki/Wikipedia_talk:Requests_for_comment/
Disallow: /wiki/Wikipedia_talk%3ARequests_for_comment/
Disallow: /wiki/Wikipedia_talk:Requests_for_adminship/
Disallow: /wiki/Wikipedia_talk%3ARequests_for_adminship/

jeluf wrote:

Please add the lines to the Mediawiki:robots.txt page on the English Wikipedia.