Page MenuHomePhabricator

[EPIC] Migrate Mediawiki jobs from Nodepool to Docker
Closed, ResolvedPublic

Description

Jenkins jobs running PHPUnit for MediaWiki core,extensions,skins account for ~ 40% of the builds happening on Nodepool. We must migrate them to Docker.

Result from running quibble-vendor-mysql-php70-docker April 27th-29th which uses mediawiki/vendor, not composer install (that causes some to fail). The console logs will eventually be automatically discarded in a few days so I should probably save them somewhere.

Webdriver tests from mediawiki might fail due to a javascript alert box or extensions changing page content.

See also: QA report.

Skins

All the skins have been migrated

Extensions

Due to bad interaction with core wdio tests T196960

wdio daily tests

Done for what we needed. Was T188742

Gate T197469

Done for extension, core and vendor.

BlueSpice

No more needed. Tracking moved to T130811

Extension registry lacks config

T198331(WMF) CognateDone
T198330(WMF) GlobalPreferencesDone
T196567ReadingListsDone
T196173GoogleLoginDone
ReasonExtensionConsole
T203084DonationInterface
grunt-contrib-qunit requires PhantomJS T180171(WMF) ArticlePlaceholderhttps://integration.wikimedia.org/ci/job/quibble-vendor-mysql-php70-docker/660/consoleFull

Broken ones:

ReasonExtensionConsole
T198919 requires npm install, Non votingLinkedWikidone marked as broken
T196504 Non votingSiteSettingsdone marked as broken
T198089 Non votingWikiLexicalDatadone marked as broken

Irremediably broken

Semantic MediaWiki is on GitHub and to be installed via composer. That installs a few other extensions in the process. Unfortunately they fail to pass our usual linters and the MediaWiki core test suite. So there is really nothing Wikimedia CI can do to support them. A few other extensions are broken or using die() with no fallback ...

ReasonExtension
Non voting T159058 T193808ArticleFeedbackv5
SemanticMediawiki / SemanticFormsHierarchyBuilder
T196444 Non votingHtml2Wiki
T117659MathSearch
T196529RevisionCommentSupplement
SemanticMediawikiSemanticACL
SemanticMediawikiSemanticDependency
SemanticMediawikiSemanticImageAnnotator
SemanticMediawikiSemanticImageInput
SemanticMediawikiSemanticInternalObjects
SemanticMediawikiSemanticPageSeries
SemanticMediawikiSemanticTasks

Broken due to AuthManager T110291

Details

SubjectRepoBranchLines +/-
mediawiki/extensions/CollapsibleVectorREL1_31+4 -1
mediawiki/extensions/ArticlePlaceholdermaster+5 -13
integration/configmaster+3 -197
integration/configmaster+0 -27
integration/configmaster+1 -8
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+0 -66
integration/configmaster+12 -21
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+0 -16
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -3
integration/configmaster+1 -3
integration/configmaster+0 -72
integration/configmaster+12 -7
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -5
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+39 -23
integration/configmaster+1 -2
integration/configmaster+2 -4
integration/configmaster+1 -2
integration/configmaster+1 -3
integration/configmaster+3 -9
integration/configmaster+1 -3
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -1
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -4
integration/configmaster+1 -3
integration/configmaster+1 -3
integration/configmaster+1 -3
integration/configmaster+1 -3
integration/configmaster+1 -3
integration/configmaster+1 -3
integration/configmaster+1 -2
integration/configmaster+2 -5
integration/configmaster+1 -2
integration/configmaster+6 -11
integration/configmaster+1 -2
integration/configmaster+1 -3
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+4 -9
integration/configmaster+1 -2
integration/configmaster+23 -2
integration/configmaster+4 -8
integration/configmaster+1 -2
integration/configmaster+1 -3
integration/configmaster+5 -10
integration/configmaster+1 -2
integration/configmaster+2 -4
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+1 -3
integration/configmaster+1 -2
integration/configmaster+1 -4
integration/configmaster+1 -2
integration/configmaster+1 -2
integration/configmaster+33 -66
integration/configmaster+9 -18
integration/configmaster+6 -12
integration/configmaster+4 -8
integration/configmaster+1 -2
mediawiki/extensions/CollapsibleVectormaster+4 -1
integration/configmaster+18 -40
integration/configmaster+6 -12
integration/configmaster+2 -4
integration/configmaster+97 -195
integration/configmaster+20 -39
integration/configmaster+47 -96
integration/configmaster+37 -75
integration/configmaster+35 -70
integration/configmaster+46 -92
integration/configmaster+40 -79
integration/configmaster+40 -78
integration/configmaster+28 -55
integration/configmaster+37 -75
integration/configmaster+9 -18
integration/configmaster+22 -43
integration/configmaster+30 -93
Show related patches Customize query in gerrit

Related Objects

StatusSubtypeAssignedTask
OpenNone
Resolvedhashar
Resolvedhashar
Resolvedhashar
Resolvedhashar
Resolvedhashar
Resolvedhashar
ResolvedMaxSem
ResolvedCommunityTechBot
DuplicateNone
Resolvedhashar
ResolvedLegoktm
Resolvedhashar
Resolvedhashar
ResolvedEjegg
Resolvedhashar
DeclinedJayprakash12345
Resolvedhashar
Resolvedhashar
ResolvedAnomie
ResolvedOsnard
ResolvedRequestMarcoAurelio
ResolvedRequestMarcoAurelio
Resolvedhashar
ResolvedRequestMarcoAurelio
ResolvedRequestMarcoAurelio
DeclinedNone
OpenNone
Resolvedhashar
Resolvedhashar
ResolvedPastakhov
Resolvedhashar
Resolvedhashar
Resolvedthiemowmde
Resolvedhashar
Resolvedhashar
Resolvedhashar
ResolvedLucas_Werkmeister_WMDE
Resolvedhashar
Resolvedhashar
ResolvedPRODUCTION ERRORLegoktm
Resolvedhashar
Resolvedhashar
Resolvedhashar
ResolvedKarima
DeclinedNone
Resolvedhashar
Resolvedhashar
Resolvedhashar
Resolvedhashar
ResolvedAddshore
ResolvedAddshore
ResolvedAddshore
ResolvedAddshore
ResolvedAddshore
ResolvedAddshore
Resolvedhashar
Resolvedhashar
Resolvedhashar

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes

Change 447216 merged by jenkins-bot:
[integration/config@master] Migrate GlobalPreferences to Quibble

https://gerrit.wikimedia.org/r/447216

Change 448368 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] Migrate Cognate to Quibble

https://gerrit.wikimedia.org/r/448368

Change 448368 merged by jenkins-bot:
[integration/config@master] Migrate Cognate to Quibble

https://gerrit.wikimedia.org/r/448368

Change 449617 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] Migrate ProofreadPage to Quibble

https://gerrit.wikimedia.org/r/449617

Change 449617 merged by jenkins-bot:
[integration/config@master] Migrate ProofreadPage to Quibble

https://gerrit.wikimedia.org/r/449617

Change 454087 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] Name dependent mediawiki queue based on a Quibble job

https://gerrit.wikimedia.org/r/454087

Change 454087 merged by jenkins-bot:
[integration/config@master] Name dependent mediawiki queue based on a Quibble job

https://gerrit.wikimedia.org/r/454087

Change 454154 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] Remove unused mediawiki-phpunit-* jobs

https://gerrit.wikimedia.org/r/454154

Change 454154 merged by jenkins-bot:
[integration/config@master] Remove unused mediawiki-phpunit-* jobs

https://gerrit.wikimedia.org/r/454154

Just an update to the status 1 year on:

image.png (267×950 px, 44 KB)

Change 454296 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] WikiLexicalData is broken

https://gerrit.wikimedia.org/r/454296

Change 454296 merged by jenkins-bot:
[integration/config@master] WikiLexicalData is broken

https://gerrit.wikimedia.org/r/454296

Change 454298 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] SiteSettings extension is broken

https://gerrit.wikimedia.org/r/454298

Change 454298 merged by jenkins-bot:
[integration/config@master] SiteSettings extension is broken

https://gerrit.wikimedia.org/r/454298

Change 454300 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] LinkedWiki extension is broken

https://gerrit.wikimedia.org/r/454300

Change 454300 merged by jenkins-bot:
[integration/config@master] LinkedWiki extension is broken

https://gerrit.wikimedia.org/r/454300

Change 454307 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] Migrate Lingo to Quibble

https://gerrit.wikimedia.org/r/454307

Change 454307 merged by jenkins-bot:
[integration/config@master] Migrate Lingo to Quibble

https://gerrit.wikimedia.org/r/454307

Change 454768 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] rm wikimedia-fundraising-civicrm-jessie

https://gerrit.wikimedia.org/r/454768

Change 454768 merged by jenkins-bot:
[integration/config@master] rm wikimedia-fundraising-civicrm-jessie

https://gerrit.wikimedia.org/r/454768

Change 454856 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] Migrate MOOC to Quibble

https://gerrit.wikimedia.org/r/454856

hashar updated the task description. (Show Details)

Change 454856 merged by jenkins-bot:
[integration/config@master] Archive MOOC extension

https://gerrit.wikimedia.org/r/454856

Change 455141 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] Migrate ORES to Quibble

https://gerrit.wikimedia.org/r/455141

Change 455141 merged by jenkins-bot:
[integration/config@master] Migrate ORES to Quibble

https://gerrit.wikimedia.org/r/455141

Change 455147 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] Remove non voting PHPUnit tests

https://gerrit.wikimedia.org/r/455147

Change 455150 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] Clean up non-voting MediaWiki jobs

https://gerrit.wikimedia.org/r/455150

Change 455147 merged by jenkins-bot:
[integration/config@master] Remove non voting PHPUnit tests

https://gerrit.wikimedia.org/r/455147

Change 455150 merged by jenkins-bot:
[integration/config@master] Clean up non-voting MediaWiki jobs

https://gerrit.wikimedia.org/r/455150

Change 456276 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] Migrate TrustedXFF to Quibble

https://gerrit.wikimedia.org/r/456276

Change 456276 merged by jenkins-bot:
[integration/config@master] Migrate TrustedXFF to Quibble

https://gerrit.wikimedia.org/r/456276

Change 457855 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] Migrate ReadingLists to Quibble

https://gerrit.wikimedia.org/r/457855

Change 457855 merged by jenkins-bot:
[integration/config@master] Migrate ReadingLists to Quibble

https://gerrit.wikimedia.org/r/457855

Change 462897 had a related patch set uploaded (by Hashar; owner: Hashar):
[mediawiki/extensions/ArticlePlaceholder@master] Remove grunt-contrib-qunit test runner

https://gerrit.wikimedia.org/r/462897

Change 462898 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] Migrate ArticlePlaceholder to Quibble

https://gerrit.wikimedia.org/r/462898

Change 462901 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] Remove mwext-qunit-composer-jessie

https://gerrit.wikimedia.org/r/462901

Change 462902 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] Phase out mwext-testextension*

https://gerrit.wikimedia.org/r/462902

Change 462898 merged by jenkins-bot:
[integration/config@master] Migrate ArticlePlaceholder to Quibble

https://gerrit.wikimedia.org/r/462898

Change 462901 merged by jenkins-bot:
[integration/config@master] Remove mwext-qunit-composer-jessie

https://gerrit.wikimedia.org/r/462901

Change 462902 merged by jenkins-bot:
[integration/config@master] Phase out mwext-testextension*

https://gerrit.wikimedia.org/r/462902

Change 462897 merged by jenkins-bot:
[mediawiki/extensions/ArticlePlaceholder@master] Remove grunt-contrib-qunit test runner

https://gerrit.wikimedia.org/r/462897

The jobs to test Wikibase client and repo have been migrated. They were the last ones still relying on Nodepool.

Change 652940 had a related patch set uploaded (by Umherirrender; owner: Hashar):
[mediawiki/extensions/CollapsibleVector@REL1_31] build: jscs should ignore vendor/

https://gerrit.wikimedia.org/r/652940

Change 652940 merged by Umherirrender:
[mediawiki/extensions/CollapsibleVector@REL1_31] build: jscs should ignore vendor/

https://gerrit.wikimedia.org/r/652940