Block crawlers from wsexport and its staging
ClosedPublic
Actions

Authored by MaxSem on May 8 2019, 2:23 AM.

Details

Reviewers

Andrew
Bstorm
bd808
Samwilson

Commits

R1922:07a15d893df0: Block crawlers from wsexport and its staging

Patch without arc

git checkout -b D1150 && curl -L https://phabricator.wikimedia.org/D1150?download=true | git apply

Summary

Bug: T222684

Diff Detail

Repository

R1922 tool-admin-web

Branch

noindex-wsexport

Lint

No Lint Coverage

Unit

No Test Coverage

Build Status

Buildable 3226
Build 5387: arc lint + arc unit

Event Timeline

MaxSem requested review of this revision.May 8 2019, 2:23 AM

MaxSem created this revision.

Harbormaster completed remote builds in B3226: Diff 2985.May 8 2019, 2:23 AM

MaxSem mentioned this in T222684: Disallow robots from scraping ebooks.May 8 2019, 2:25 AM

MaxSem added reviewers: Andrew, Bstorm, bd808.

Samwilson accepted this revision.May 8 2019, 2:29 AM

Samwilson added a reviewer: Samwilson.

bd808 accepted this revision.May 14 2019, 5:32 PM

This revision is now accepted and ready to land.May 14 2019, 5:32 PM

Closed by commit R1922:07a15d893df0: Block crawlers from wsexport and its staging (authored by MaxSem, committed by bd808). · Explain WhyMay 14 2019, 5:33 PM

This revision was automatically updated to reflect the committed changes.

Revision Contents
Changeset List

Path

Size

public/

robots.txt

4 lines

Diff 2985

View Options

Block crawlers from wsexport and its stagingClosedPublicActions