Page MenuHomePhabricator

Fix typo in robots.txt
Closed, ResolvedPublic

Description

Author: ais523

Description:
Robots.txt currently has

Disallow: /wiki/Wikipedia:Protected_titles/

but unlike all the other entries,

Disallow: /wiki/Wikipedia%3AProtected_titles/

seems to have been accidentally missed out from the file, meaning that the robots.txt crawlproofing of these pages isn't as watertight as it could be; could a dev fix this, please?


Version: unspecified
Severity: minor
URL: http://en.wikipedia.org/robots.txt

Details

Reference
bz10717

Event Timeline

bzimport raised the priority of this task from to Medium.Nov 21 2014, 9:53 PM
bzimport set Reference to bz10717.
bzimport added a subscriber: Unknown Object (MLST).