Read default wiki list from sitematrix
Closed, ResolvedPublic
Actions

Assigned To

None

Authored By

	cscott
	Nov 13 2014, 8:43 PM

Description

https://en.wikipedia.org/w/api.php?action=sitematrix&format=json
is WMF-specific, but it contains a complete mapping of dbnames to urls for all WMF sites.

We should either have a parsoid localsettings option to read this at server startup (optional, non wmf installs won't want it), or else write a simple tool to generate our default list of wikis (languages at least) statically by querying this. (And then something to notify us when our list is out of date?)

This will help ensure that we follow the creation of new wikis promptly (instead of requiring patches like https://gerrit.wikimedia.org/r/172995 ).

Currently parsoid only is configured with the 'public' wikis in the sitematrix, and the deploy:conf/wmf/localsettings.js contains definitions of the private wikis. Once we add the 'parsoidConfig.fetchWMF=true' option to localsettings, we can probably remove this distinction.

Version: unspecified
Severity: enhancement

Details

Reference: bz73385

	Subject	Repo	Branch	Lines +/-
	Read default wiki list from a cached sitematrix	mediawiki/services/parsoid	master	+105 -113

Customize query in gerrit

Related Objects

Mentioned In: rGPARfe3ec17cc8ae: Read default wiki list from a cached sitematrix

Event Timeline

• bzimport raised the priority of this task from to Needs Triage.Nov 22 2014, 3:56 AM

• bzimport added a project: Parsoid.

• bzimport set Reference to bz73385.

cscott created this task.Nov 13 2014, 8:43 PM

Some commentary:

(03:30:34 PM) legoktm: cscott: action=sitematrix&format=json ?
(03:30:36 PM) legoktm: https://en.wikipedia.org/w/api.php?action=sitematrix
(03:30:37 PM) legoktm: it's WMF-specific though
(03:32:05 PM) cscott-free: legoktm: what does 'closed' mean in that output?
(03:32:28 PM) legoktm: no one can edit the wiki except for stewards
(03:32:50 PM) legoktm: https://wikimania2010.wikimedia.org/wiki/Main_Page
(03:34:09 PM) cscott-free: i see it includes 'private' wikis as well.
(03:34:23 PM) cscott-free: what does 'fishbowl' mean?
(03:34:37 PM) legoktm: public, but editing is restricted to people with accounts
(03:34:42 PM) legoktm: and account creation is also restricted
(03:34:51 PM) legoktm: http://meatballwiki.org/wiki/FishBowl :)

This bug has been marked as a duplicate of bug 58677 ***

Change 183772 had a related patch set uploaded (by Arlolra):
Read default wiki list from a cached sitematrix

https://gerrit.wikimedia.org/r/183772

Patch-For-Review

Change 183772 merged by jenkins-bot:
Read default wiki list from a cached sitematrix