Hotfix phabricator robots.txt to exclude /multimeter/
Closed, ResolvedPublic

Description

...what it says on the box.

mmodell created this task.Aug 17 2015, 4:31 AM
mmodell updated the task description. (Show Details)
mmodell raised the priority of this task from to Unbreak Now!.
mmodell claimed this task.
mmodell added a project: Phabricator.
mmodell added a subscriber: mmodell.
Restricted Application added subscribers: scfc, Aklapper. · View Herald TranscriptAug 17 2015, 4:31 AM

Change 231983 had a related patch set uploaded (by 20after4):
Add /multimeter/ to robots.txt exclusion

https://gerrit.wikimedia.org/r/231983

Change 231983 merged by 20after4:
Add /multimeter/ to robots.txt exclusion

https://gerrit.wikimedia.org/r/231983

I changed the security policy for the multimeter app from "public" to "all users." There is no need to allow access to multimeter for the general public, or more specifically, the search engine spiders. The information in multimeter is for performance profiling and should not be indexed.

mmodell closed this task as Resolved.Aug 17 2015, 5:10 AM

Why?

Multimeter was being hit by search engines casusing unwanted load and indexing useless pages which will not have any value in the search index.

SamanthaNguyen added a subscriber: SamanthaNguyen.

Removing Patch-For-Review since this has already been merged and resolved

Restricted Application added subscribers: Jay8g, TerraCodes. · View Herald TranscriptJan 2 2017, 4:39 AM