Flow does not follow $wgNamespaceRobotPolicies
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Trizek-WMF
	Dec 22 2015, 10:23 AM

Description

French Wikipedia has a decided in 2010 to not index users pages and user talk pages. This has been setup on the global preferences (iirc). But user talk pages using Flow boards are indexed.

Examples of Google searches:

User with a Flow board - First result is my volunteer French Wikipedia user talk page
User not using Flow board - Nothing related to French Wikipedia.

Details

	Project	Branch	Lines +/-	Subject
	mediawiki/extensions/Flow	master	+33 -2	Implement robot-policy

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		None	T105322 Support robot indexing policies
		Resolved		SBisson	T122119 Flow does not follow $wgNamespaceRobotPolicies

Event Timeline

Trizek-WMF created this task.Dec 22 2015, 10:23 AM

Trizek-WMF raised the priority of this task from to High.

Trizek-WMF updated the task description. (Show Details)

Trizek-WMF added a project: StructuredDiscussions.

Trizek-WMF added a subscriber: Trizek-WMF.

Restricted Application added a project: Collaboration-Team-Triage. · View Herald TranscriptDec 22 2015, 10:23 AM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

• Mattflaschen-WMF renamed this task from Global preferences concerning talk pages indexation are not respected by Flow to Flow does not follow $wgNamespaceRobotPolicies.Dec 22 2015, 10:50 PM

• Mattflaschen-WMF set Security to None.

• Mattflaschen-WMF added a parent task: T105322: Support robot indexing policies.

• Mattflaschen-WMF mentioned this in T105322: Support robot indexing policies.

matthiasmullie mentioned this in T59154: Flow: Prettify thread permalink URLs/Titles (they are not human readable!).May 24 2016, 7:41 PM

Danny_B moved this task from Backlog to Support robot indexing policies on the StructuredDiscussions board.Jul 20 2016, 12:55 AM

Quiddity moved this task from Support robot indexing policies to Backlog on the StructuredDiscussions board.Aug 15 2016, 10:31 PM

Liuxinyu970226 added a subscriber: Liuxinyu970226.Mar 27 2017, 3:33 PM

Framawiki awarded a token.Dec 29 2017, 9:18 AM

Framawiki added a subscriber: Framawiki.

Catrope mentioned this in T122252: Have Flow support __INDEX__ and __NOINDEX__ per-page directives.Jan 4 2018, 2:31 PM

Change 403416 had a related patch set uploaded (by Sbisson; owner: Sbisson):
[mediawiki/extensions/Flow@master] Implement robot-policy

https://gerrit.wikimedia.org/r/403416

gerritbot added a project: Patch-For-Review.Jan 10 2018, 3:25 PM

SBisson claimed this task.Jan 10 2018, 3:26 PM

SBisson edited projects, added Collaboration-Team-Triage (Collab-Team-This-Quarter); removed Collaboration-Team-Triage.

SBisson moved this task from Untriaged to Needs Review on the Collaboration-Team-Triage (Collab-Team-This-Quarter) board.

Catrope moved this task from Needs Review to QA Review on the Collaboration-Team-Triage (Collab-Team-This-Quarter) board.Jan 10 2018, 11:04 PM

Change 403416 merged by jenkins-bot:
[mediawiki/extensions/Flow@master] Implement robot-policy

https://gerrit.wikimedia.org/r/403416

Trizek-WMF added a project: User-notice-collaboration.Jan 11 2018, 10:50 AM

Trizek-WMF moved this task from To Triage to Announce in next Collaboration Newsletter on the User-notice-collaboration board.Jan 11 2018, 2:46 PM

Trizek-WMF moved this task from Announce in next Collaboration Newsletter to In current Collaboration Newsletter draft on the User-notice-collaboration board.Jan 11 2018, 3:13 PM

Hey, we're moving forward, thanks @SBisson !

Checked in betalabs - User and User talk (SD and non-SD pages) are not found by google searches.

@SBisson two questions:
(1)

French Wikipedia has a decided in 2010 to not index users pages and user talk pages.

Does it mean that only French wikipedia has such a setup? And now enwiki betalabs is following that setup also?

(2) Google search cannot find any SD topic (hidden or not-hidden) in enwiki betalabs. Is it a special setup for betalabs? Nothing in betalabs gets indexed?

In T122119#3895816, @Etonkovidova wrote:

Checked in betalabs - User and User talk (SD and non-SD pages) are not found by google searches.

@SBisson two questions:
(1)

French Wikipedia has a decided in 2010 to not index users pages and user talk pages.

Does it mean that only French wikipedia has such a setup?

I count 18 wikis (including frwiki, enwiki, dewiki) that have decided to disable indexing on NS_USER and/or NS_USER_TALK.

And now enwiki betalabs is following that setup also?
(2) Google search cannot find any SD topic (hidden or not-hidden) in enwiki betalabs. Is it a special setup for betalabs? Nothing in betalabs gets indexed?

It makes sense that we don't want people searching google to land on betalabs but I don't know how it's configured. I don't see it in the config repo.