Page MenuHomePhabricator

Remove noindex robots tag from Wikifunctions main namespace
Closed, ResolvedPublicBUG REPORT

Description

Steps to replicate the issue (include links if applicable):

What happens?:
The header contains
<meta name="robots" content="noindex,nofollow,max-image-preview:standard">

What should have happened instead?:
Remove the noindex

Software version (skip for WMF-hosted wikis like Wikipedia):
Production as of 2024-01-19

Other information (browser name/version, screenshots, etc.):

Event Timeline

Change 991831 had a related patch set uploaded (by Jforrester; author: Jforrester):

[mediawiki/extensions/WikiLambda@master] SpecialViewObject: Force our bot policy to index,follow

https://gerrit.wikimedia.org/r/991831

Jdforrester-WMF changed the task status from Open to In Progress.Jan 19 2024, 6:31 PM
Jdforrester-WMF claimed this task.
Jdforrester-WMF triaged this task as High priority.
Jdforrester-WMF added a project: WikiLambda.
Jdforrester-WMF moved this task from To Triage to In Progress on the Abstract Wikipedia team board.

Should we only mark canonical URI indexable? Otherwise Google may index three duplicated pages for each object.

Should Index:
https://www.wikifunctions.org/view/en/Z1

Should not index:
https://www.wikifunctions.org/wiki/Z1
https://www.wikifunctions.org/wiki/Special:ViewObject/en/Z1

Note the later two pages have <link rel="canonical" href="..."> whose href refers to itself, not the view endpoint.

Should we only mark canonical URI indexable? Otherwise Google may index three duplicated pages for each object.

Should Index:
https://www.wikifunctions.org/view/en/Z1

Should not index:
https://www.wikifunctions.org/wiki/Z1
https://www.wikifunctions.org/wiki/Special:ViewObject/en/Z1

Note the later two pages have <link rel="canonical" href="..."> whose href refers to itself, not the view endpoint.

That's a distinct concern. Filed as T355546: Make SpecialViewObject only mark-canonical for the /view/<lang>/<foo> URL, not /wiki/<foo> or /wiki/Special:ViewObject/<lang>/<foo>.

Eh, so please double check pages with index,follow but <link rel="canonical" href="..."> points to elsewhere are not indexed

Change 991831 merged by jenkins-bot:

[mediawiki/extensions/WikiLambda@master] SpecialViewObject: Force our bot policy to index,follow

https://gerrit.wikimedia.org/r/991831