I requested a project for this to happen in in T194239

We now have both a quota increase request (T193185: Increase quota for wikidata-federation project) and a new project request (T194239: Request creation of mcr-dev VPS project) submitted with this goal as the parent. Are both actually needed? If only one is needed, which is the more useful?

@bd808 for SDC, we really want T194239. T193185 may come in handy as a short term solution. And the Wikidata team may want it anyway (or they may not).

The mcr-dev project has three machines now:

• mcr-base.wmflabs.org (box: mcr-base.mcr-dev.eqiad.wmflabs) is a plain MediaWiki (via Labs-Vagrant), with 405015 and 434183 cherry-picked
• mcr-full.wmflabs.org (box: mcr-full.mcr-dev.eqiad.wmflabs) is for testing lots of extensions (none set up yet, please suggest what should be used)
• mcr-sdc.wmflabs.org (box: mcr-sdc.mcr-dev.eqiad.wmflabs) is an SDC-like testing environment (WIP, should include a commons-like wiki with Wikibase client + repo + WikibaseMediaInfo and a Wikidata-like wiki with Wikibase repo)

TODO:

• agree on the list of extensions for mcr-full and install them
• vagrant role for WikibaseMediaInfo
  • AIUI this will require Wikibase Repo to be installed on the dev and wikidata wikis but not any other one, which might require some refactoring of how Vagrant handles per-wiki config

@Tgr thank you for setting this up!

Rough plan, going forward:

• test PageUpdater on mcr-full (https://gerrit.wikimedia.org/r/c/434183/)
  • run all the selenium tests
• merge PageUpdater

• test multi-content RevisionStore on mcr-full with (https://gerrit.wikimedia.org/r/c/416465) with MIGRATION_WRITE_BOTH
  • run all the selenium tests
• merge multi-content RevisionStore, with MIGRATION_WRITE_BOTH. Do we need to hard code a check that forbids MIGRATION_NEW for now.
• test multi-content RevisionStore on mcr-full (or another instance?!) with (https://gerrit.wikimedia.org/r/c/416465) with MIGRATION_NEW
  • run all the selenium tests
• merge patch allowing MIGRATION_NEW in code, making it the default for new installations (patch TBD)

In T192306#4233454, @Tgr wrote:

mcr-full.wmflabs.org is for testing lots of extensions (none set up yet, please suggest what should be used)

Draft here: https://etherpad.wikimedia.org/p/mcr-full

@Tgr since there are only so few selenium tests for core, and the changes that PageUpdater makes mostly impact when and how hook functions are called, I now think we should test it against mcr-full before merging it. I'll edit my previous comment accordingly.

mcr-full is broken currently due to T195959: Labs-Vagrant cannot reuse the same HTTP(S) port after vagrant reload and also some kind of error with the visualeditor and globalimageusage roles. I'll fix those and test.

tgr@mcr-full:/srv/mediawiki-vagrant$ vagrant roles list -e
Enabled roles:

abusefilter                eventlogging               newusermessage            
antispam                   flow                       templatesandbox           
babel                      geodata                    translate                 
cite                       globalcssjs                visualeditor              
codeeditor                 globalusage                warnings_as_errors        
confirmedit                hhvm                       wikieditor                
echo                       mobilefrontend             wikilove

All issues fixed, I think; at the very least, it provisions cleanly.

mcr-full works fine for manual testing but most of the selenium tests fail, probably due to some of the extensions interfering. I'm not sure how to track that down without visuals, and could not get that to work (T196646: Running selenium inside Vagrant with xvfb or X11 does not work).

Daniel has set up mcr-sdc and made a proper vagrant role for wikibasemediainfo.

Things that could be done (beyond manual testing):

• add wikidata and commons to mcr-full
• T93047: Create vagrant role for master-slave DB setup

I have created a branch called McrStorageLayerTest on mcr-full.wmflabs now. It has three changes on it:

• https://gerrit.wikimedia.org/r/c/mediawiki/core/+/406595
• https://gerrit.wikimedia.org/r/c/mediawiki/core/+/416465
• https://gerrit.wikimedia.org/r/c/mediawiki/core/+/405015

This is also what we want to deploy to testwiki tomorrow.

Change 405015 had a related patch set uploaded (by Gergő Tisza; owner: Daniel Kinzler):
[mediawiki/core@master] [MCR] Factor PageUpdater out of WikiPage

https://gerrit.wikimedia.org/r/405015