Maniphest T298902

Add robots.txt to wbcloud mediawiki deployment
Open, Needs TriagePublic
Actions

Assigned To

None

Authored By

	Addshore
	Jan 10 2022, 6:23 PM

Tags

Referenced Files

None

Subscribers

Description

It was recently pointed out that the wbstack mediawiki doesn't currently have a robots.txt
It probably should.

We should add a robots.txt file to thee wiki service, probably using sensible mediawiki / wikibase defaults)

ACs:

<wiki>.wikibase.cloud/robots.txt returns a valid robot.txt
on staging/wikibase.dev, the robots.txt declines indexing (examples)

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open	Feature	None	T16720 robots.txt (tracking)
		Open		None	T298902 Add robots.txt to wbcloud mediawiki deployment

Event Timeline

Addshore created this task.Jan 10 2022, 6:23 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 10 2022, 6:23 PM

GreenReaper subscribed.Jan 10 2022, 6:25 PM

• Samantha_Alipio_WMDE moved this task from Ready to Pick Up to Backlog (incoming) on the Wikibase Cloud board.Jan 25 2022, 3:26 PM

Deniz_WMDE mentioned this in T306704: Add robots.txt for staging.May 2 2022, 12:36 PM

Deniz_WMDE updated the task description. (Show Details)May 2 2022, 12:43 PM

Deniz_WMDE merged a task: T306704: Add robots.txt for staging.May 2 2022, 12:45 PM

Deniz_WMDE subscribed.

Shizhao added a parent task: T16720: robots.txt (tracking).Oct 8 2022, 11:40 AM