Spike to make sure we're able to convert a whole namespace of wikitext pages to Flow.
This involves running a test conversion on testwiki, evaluating, and making reasonable fixes within a 2-point timebox.
If the evaluation and fixes turns out to be bigger than 2 points, then we should call this done, create a new ticket, and estimate it for another sprint.
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | • DannyH | T99117 Turn Flow on for Catalan's Viquipèdia talk namespace | |||
| Resolved | matthiasmullie | T98384 B5. Spike: Namespace conversion for wikitext talk pages -- test conversion on testwiki, make reasonable fixes |
I've tried on my local machine & submitted 2 more patches (https://gerrit.wikimedia.org/r/#/c/215330/ & https://gerrit.wikimedia.org/r/#/c/215331/)
They just fix some valid conditions under which import could "fail" (but not really). We just need to get those merged before doing a big import (to not spam output with exceptions for valid cases), but I can test the import without those.
Talk namespaces on testwiki & the amount of pages in each of them:
| NS_TALK | 193 |
| NS_USER_TALK | 2541 |
| NS_PROJECT_TALK | 70 |
| NS_FILE_TALK | 17 |
| NS_MEDIAWIKI_TALK | 49 |
| NS_TEMPLATE_TALK | 146 |
| NS_HELP_TALK | 3 |
| NS_CATEGORY_TALK | 10 |
I suggest to try NS_HELP_TALK or NS_CATEGORY_TALK first, then NS_TALK?
Steps:
Test importing Help_talk ok!
All 3 pages were converted as expected:
http://test.wikipedia.org/wiki/Help_talk:Article_validation (archive at http://test.wikipedia.org/wiki/Help_talk:Article_validation/Archive_1)
http://test.wikipedia.org/wiki/Help_talk:Page_validation (archive at http://test.wikipedia.org/wiki/Help_talk:Page_validation/Archive_1)
http://test.wikipedia.org/wiki/Help_talk:%D7%90 (archive at http://test.wikipedia.org/wiki/Help_talk:%D7%90/Archive_1)
I didn't add Help_talk to $wgFlowOccupyNamespaces, which means that new pages in that namespace will still be wikitext pages (that needs a config change, which needs to be deployed right away - there was no reason to go through this to test conversion)
Script output:
[2015-06-03 11:02:37] Starting conversion of Help_talk namespace
[2015-06-03 11:02:37] Archiving page from Help talk:א to Help talk:א/Archive 1
[2015-06-03 11:02:40] Importing to Help talk:א
[2015-06-03 11:02:41] Importing header
[2015-06-03 11:02:42] Imported 1 revisions for header
[2015-06-03 11:02:42] Imported 1 items, failed 0
[2015-06-03 11:02:43] Completed import to Help talk:א from Help talk:א/Archive 1
[2015-06-03 11:02:43] Archiving page from Help talk:Article validation to Help talk:Article validation/Archive 1
[2015-06-03 11:02:44] Importing to Help talk:Article validation
[2015-06-03 11:02:44] Importing header
[2015-06-03 11:02:50] Imported 1 revisions for header
[2015-06-03 11:02:50] Imported 1 items, failed 0
[2015-06-03 11:02:50] Completed import to Help talk:Article validation from Help talk:Article validation/Archive 1
[2015-06-03 11:02:50] Archiving page from Help talk:Page validation to Help talk:Page validation/Archive 1
[2015-06-03 11:02:51] Importing to Help talk:Page validation
[2015-06-03 11:02:51] Importing header
[2015-06-03 11:02:54] Imported 1 revisions for header
[2015-06-03 11:02:54] Imported 1 items, failed 0
[2015-06-03 11:02:54] Completed import to Help talk:Page validation from Help talk:Page validation/Archive 1
[2015-06-03 11:02:54] Exception while importing: Help talk:א
[2015-06-03 11:02:54] exception 'Flow\Exception\FlowException' with message 'Not allowed to convert: Help talk:א' in /srv/mediawiki-staging/php-1.26wmf8/extensions/Flow/includes/Import/Converter.php:125
Stack trace:
#0 /srv/mediawiki-staging/php-1.26wmf8/extensions/Flow/includes/Import/Converter.php(108): Flow\Import\Converter->convert(Object(Title))
#1 /srv/mediawiki-staging/php-1.26wmf8/extensions/Flow/maintenance/convertNamespaceFromWikitext.php(58): Flow\Import\Converter->convertAll(Object(EchoCallbackIterator))
#2 /srv/mediawiki-staging/php-1.26wmf8/maintenance/doMaintenance.php(103): ConvertNamespaceFromWikitext->execute()
#3 /srv/mediawiki-staging/php-1.26wmf8/extensions/Flow/maintenance/convertNamespaceFromWikitext.php(63): require_once('/srv/mediawiki-...')
#4 /srv/mediawiki-staging/multiversion/MWScript.php(97): require_once('/srv/mediawiki-...')
#5 {main}
[2015-06-03 11:02:54] Exception while importing: Help talk:Article validation
[2015-06-03 11:02:54] exception 'Flow\Exception\FlowException' with message 'Not allowed to convert: Help talk:Article validation' in /srv/mediawiki-staging/php-1.26wmf8/extensions/Flow/includes/Import/Converter.php:125
Stack trace:
#0 /srv/mediawiki-staging/php-1.26wmf8/extensions/Flow/includes/Import/Converter.php(108): Flow\Import\Converter->convert(Object(Title))
#1 /srv/mediawiki-staging/php-1.26wmf8/extensions/Flow/maintenance/convertNamespaceFromWikitext.php(58): Flow\Import\Converter->convertAll(Object(EchoCallbackIterator))
#2 /srv/mediawiki-staging/php-1.26wmf8/maintenance/doMaintenance.php(103): ConvertNamespaceFromWikitext->execute()
#3 /srv/mediawiki-staging/php-1.26wmf8/extensions/Flow/maintenance/convertNamespaceFromWikitext.php(63): require_once('/srv/mediawiki-...')
#4 /srv/mediawiki-staging/multiversion/MWScript.php(97): require_once('/srv/mediawiki-...')
#5 {main}
[2015-06-03 11:02:54] Exception while importing: Help talk:Page validation
[2015-06-03 11:02:54] exception 'Flow\Exception\FlowException' with message 'Not allowed to convert: Help talk:Page validation' in /srv/mediawiki-staging/php-1.26wmf8/extensions/Flow/includes/Import/Converter.php:125
Stack trace:
#0 /srv/mediawiki-staging/php-1.26wmf8/extensions/Flow/includes/Import/Converter.php(108): Flow\Import\Converter->convert(Object(Title))
#1 /srv/mediawiki-staging/php-1.26wmf8/extensions/Flow/maintenance/convertNamespaceFromWikitext.php(58): Flow\Import\Converter->convertAll(Object(EchoCallbackIterator))
#2 /srv/mediawiki-staging/php-1.26wmf8/maintenance/doMaintenance.php(103): ConvertNamespaceFromWikitext->execute()
#3 /srv/mediawiki-staging/php-1.26wmf8/extensions/Flow/maintenance/convertNamespaceFromWikitext.php(63): require_once('/srv/mediawiki-...')
#4 /srv/mediawiki-staging/multiversion/MWScript.php(97): require_once('/srv/mediawiki-...')
#5 {main}Those 3 exceptions were expected: 3 wikitext pages were moved & a flow-board was created for them, after which it encountered the flow-boards and skipped them. One of the patches in gerrit will make those silent, so we don't get those confusing exceptions anymore.
NS_TALK converted as well.
I've checked a couple of pages and conversion seems fine. E.g.:
If anyone's interested in checking more, here's a list of all pages in that namespace: https://phabricator.wikimedia.org/P717
There were a couple of failures, but all seem acceptable:
Subpage without matching subject page
Redirect
Already Flow
Script output: https://phabricator.wikimedia.org/P716 - all other failures in this file are when pages-that-have-just-been-converted are revisited and ignored (because they're already a Flow board)