Page MenuHomePhabricator
Create Task
Maniphest T119140

[keyresult] Migrate as many misc CI jobs as possible to Nodepool
Closed, ResolvedPublic
Actions

Description

Nov 4th 201653 jobs
Jan 10th 201746 jobs
Mar 13th 201726 jobs
Mar 14th 2017 23 jobs
Mar 30th 201721 jobs
May 1st 201720 jobs
$ grep -l UbuntuTrusty *
analytics-refinery-release
analytics-refinery-update-jars
analytics-wikistats
composer-package-validate
composer-validate
jsduck
mediawiki-core-jsduck
mediawiki-vendor-composer-security
mwext-CirrusSearch-whitespaces
mwext-VisualEditor-jsduck
mwgate-composer-validate
mwgate-jsduck
operations-dns-tabs
operations-mw-config-typos
performance-webpagetest-wmf
performance-webpagetest-wpt-org
php-compile-hhvm
php-compile-hhvm-test
php-compile-php55
wikimedia-fundraising-civicrm

Details

Show related patches Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 DuplicateNoneT125017 Switch Parsoid to Jessie and Node 4.2
 ResolvedhasharT119138 [keyresult] Migrate majority of CI jobs to Nodepool (part 2)
 DuplicateNoneT136249 Track what tests we have left to convert to nodepool
 ResolvedhasharT119140 [keyresult] Migrate as many misc CI jobs as possible to Nodepool
 ResolvedhasharT114315 [keyresult] Migrate majority of CI jobs to Nodepool (part 1)
 ResolvedgregT119141 Migrate python tox CI jobs to Nodepool
 ResolvedhasharT103251 Create generic "tox" job that runs multiple environments
ResolvedhasharT126588 Migrate leftover tox jobs to CI Nodepool
 ResolvedLegoktmT126532 Wikipedia Android CI tests are failing
 ResolvedhasharT119143 Migrate javascript npm CI jobs to Nodepool
 ResolvedhasharT113903 Puppetize npm/grunt manual setup
 ResolvedhasharT95003 Use systemd for xvfb service on Debian/Jessie
 ResolvedhasharT112560 [tracking] Disposable VMs need a cache for package managers
 ResolvedhasharT112561 Evaluate angry-caching-proxy as a package managers cache
 ResolvedhasharT114871 Evaluate devpi for caching Pypi python packages
 DeclinedhasharT116015 Investigate using a Squid based man in the middle proxy to cache package manager SSL connections
 ResolvedhasharT116017 Investigate using a cache store/restore system for package managers
 DeclinedhasharT116038 Investigate using Drydock for CI
 ResolvedhasharT117207 Puppetize / play out with devpi
 DeclinedhasharT119196 Investigate using gemstash
 ResolvedhasharT126991 Migrate services CI jobs to node 4.3
 ResolvedhasharT106668 Enable jenkins test & submit for graphoid repo
 Resolved• mobrovacT119693 Extract Graphoid Debian packages dependencies to a standalone puppet class so they can be installed on CI slaves
 ResolvedhasharT129092 Hiera is not properly configured on Nodepool instances
 ResolvedhasharT126230 Provision pkg-config on Nodepool instances
 Resolved• mobrovacT124447 Enable node4 for mathoid tests (mathoid/deploy tests fail)
 ResolvedhasharT126246 Provision openjdk-7-jre-headless on Nodepool slaves
 DuplicateNoneT129880 Give @mobrovac access to CI instances
 ResolvedhasharT126992 Migrate Parsoid CI jobs to Nodepool and add Node 4.3 support
 ResolvedhasharT124474 Package npm 2.14
 ResolvedhasharT126995 Migrate mediawiki/services/mobileapps CI jobs from node 0.10 to 4.3
 ResolvedhasharT127447 Migrate cxserver CI jobs to nodeJs 4.3
 ResolvedPaladoxT128089 Migrate OOjs npm CI job to Nodepool
 ResolvedhasharT128091 Migrate OOjs UI npm, npm-run-doc and npm-run-demos CI jobs to Nodepool
 ResolvedhasharT128092 Provide composer on the nodepool servers so OOjs UI can use it in the npm job
 ResolvedhasharT128093 Migrate VisualEditor core npm CI job to Nodepool
 ResolvedhasharT128090 Provide the Chrome binary on the nodepool servers so OOjs, VE core can use it in testing
 ResolvedhasharT129320 Diskimage fail on xvfb/systemd
 ResolvedhasharT129345 Xvfb service does not start on Nodepool instances
 InvalidNoneT128135 Jessie should have the ability to run several tests at once like UbuntuTrusty can
 ResolvedhasharT130207 Migrate pywikibot/i18n npm job to Nodepool
 DeclinedNoneT130208 Jobs should checkout source in a subdirectory of the workspace to avoid polluting it with CI related files
 ResolvedhasharT130587 Migrate MobileFrontend npm job to Nodepool
 ResolvedhasharT109005 Switch CI from jsduck deb package to a gemfile/bundler system
 ResolvedhasharT136096 Create jsduck job that runs on Nodepool instances
 ResolvedhasharT132144 Migrate mediawiki/extensions/Collection/OfflineContentGenerator npm jobs to Nodepool instances / Node 4.3
 ResolvedzeljkofilipinT114860 Move Bundler Jenkins jobs to Nodepool instances
 ResolveddduvallT104024 Define a CI entry point for Ruby code
 DuplicatezeljkofilipinT114262 Delete ruby2.0lint job and only run bundle-rubocop job for repositories with Ruby code
 ResolvedhasharT136301 Migrate qunit jobs to Nodepool
 ResolvedhasharT136307 Apt mirror for Ubuntu Trusty hash sum mismatch
 ResolvedhasharT136188 qunit jobs have karma stall when chromium disconnect
 ResolvedhasharT160394 Replace job translatewiki-shelllint and have its functionality invoked from composer
 ResolvedEjeggT171724 wikimedia-fundraising-civicrm fails with Call to a member function getDriver() on null in phar:///srv/jenkins-workspace/workspace/wikimedia-fundraising-civicrm/src/wikimedia/fundraising/civicrm-buildkit/bin/amp/src/Amp/Database/MySQL.php on line 58

Event Timeline

greg created this task.Nov 19 2015, 10:53 PM
greg raised the priority of this task from to Medium.
greg updated the task description. (Show Details)
greg added a project: Continuous-Integration-Config.
greg added subscribers: hashar, Aklapper, greg.
hashar added projects: Continuous-Integration-Scaling, OKR-Work.Nov 20 2015, 2:48 PM
greg added a project: releng-201516-q3.Dec 2 2015, 9:35 PM
greg set Security to None.
hashar added a subtask: T114315: [keyresult] Migrate majority of CI jobs to Nodepool (part 1).Dec 3 2015, 8:39 AM
greg renamed this task from Migrate as many misc CI jobs as possible to Nodepool to [keyresult] Migrate as many misc CI jobs as possible to Nodepool.Jan 20 2016, 12:14 AM
Paladox subscribed.May 25 2016, 9:39 PM
hashar closed subtask T114315: [keyresult] Migrate majority of CI jobs to Nodepool (part 1) as Resolved.May 25 2016, 9:42 PM
hashar created subtask T136301: Migrate qunit jobs to Nodepool.May 26 2016, 1:42 PM
hashar closed subtask T136301: Migrate qunit jobs to Nodepool as Resolved.Jun 6 2016, 1:04 PM
greg added a comment.Jun 6 2016, 5:03 PM

\o/ ?

hashar added a comment.Jun 6 2016, 9:40 PM

More or less, at least part 1 is complete. Part 2 is T119138 and is made of:

  • T119139 Migrate PHP based jobs, a lot of that is accomplished
  • T119140 (this task): leftover / misc

I am willing to complete as much as what is remaining from PHP and will reuse this misc task as a parent task for the huge remaining.

Currently 58 jobs are on Nodepool and 195 on permanent slaves (the ratio does not reflect the actual usage, some jobs are way more used and are already on Nodepool). Random examples:

So potentially that bullet list would end up as sub tasks here :-)

Paladox added a parent task: T136249: Track what tests we have left to convert to nodepool.Aug 28 2016, 12:00 AM
gerritbot subscribed.Oct 7 2016, 1:42 PM

Change 314688 had a related patch set uploaded (by Hashar):
Let castor save from publish pipeline

https://gerrit.wikimedia.org/r/314688

gerritbot added a project: Patch-For-Review.Oct 7 2016, 1:42 PM
gerritbot added a comment.Oct 7 2016, 1:55 PM

Change 314690 had a related patch set uploaded (by Hashar):
Migrate unicodejs-publish to Nodepool

https://gerrit.wikimedia.org/r/314690

gerritbot added a comment.Oct 7 2016, 1:56 PM

Change 314688 merged by jenkins-bot:
Let castor save from postmerge pipeline

https://gerrit.wikimedia.org/r/314688

gerritbot added a comment.Oct 7 2016, 1:57 PM

Change 314690 merged by jenkins-bot:
Migrate unicodejs-publish to Nodepool

https://gerrit.wikimedia.org/r/314690

gerritbot added a comment.Oct 14 2016, 9:49 AM

Change 315919 had a related patch set uploaded (by Hashar):
tox doc publishing jobs to Nodepool/Jessie

https://gerrit.wikimedia.org/r/315919

gerritbot added a comment.Oct 14 2016, 9:54 AM

Change 315919 merged by jenkins-bot:
tox doc publishing jobs to Nodepool/Jessie

https://gerrit.wikimedia.org/r/315919

gerritbot added a comment.Oct 25 2016, 2:56 PM

Change 317830 had a related patch set uploaded (by Hashar):
phpunit-coverage-publish to Nodepool

https://gerrit.wikimedia.org/r/317830

gerritbot added a comment.Oct 25 2016, 2:59 PM

Change 317830 merged by jenkins-bot:
phpunit-coverage-publish to Nodepool

https://gerrit.wikimedia.org/r/317830

gerritbot added a comment.Nov 2 2016, 10:45 AM

Change 319292 had a related patch set uploaded (by Hashar):
dib: doxygen on Jessie images

https://gerrit.wikimedia.org/r/319292

gerritbot added a comment.Nov 2 2016, 10:46 AM

Change 319292 merged by jenkins-bot:
dib: doxygen on Jessie images

https://gerrit.wikimedia.org/r/319292

Stashbot subscribed.Nov 2 2016, 10:47 AM

Mentioned in SAL (#wikimedia-releng) [2016-11-02T10:47:39Z] <hashar> Force refresh Nodepool snapshot for Jessie so it get doxygen included T119140

gerritbot added a comment.Nov 2 2016, 11:13 AM

Change 319296 had a related patch set uploaded (by Hashar):
Migrate doxygen jobs to Nodepool/Jessie

https://gerrit.wikimedia.org/r/319296

gerritbot added a comment.Nov 2 2016, 11:41 AM

Change 319296 merged by jenkins-bot:
Migrate doxygen jobs to Nodepool/Jessie

https://gerrit.wikimedia.org/r/319296

gerritbot added a comment.Nov 2 2016, 12:12 PM

Change 319305 had a related patch set uploaded (by Hashar):
mediawiki-core-doxygen-publish to Jessie/Nodepool

https://gerrit.wikimedia.org/r/319305

gerritbot added a comment.Nov 2 2016, 12:27 PM

Change 319305 merged by jenkins-bot:
mediawiki-core-doxygen-publish to Jessie/Nodepool

https://gerrit.wikimedia.org/r/319305

gerritbot added a comment.Nov 2 2016, 2:02 PM

Change 319324 had a related patch set uploaded (by Hashar):
php-compile jobs to Nodepool

https://gerrit.wikimedia.org/r/319324

gerritbot added a comment.Nov 2 2016, 2:58 PM

Change 319332 had a related patch set uploaded (by Hashar):
mediawiki-core-jsduck-publish migrate to Nodepool

https://gerrit.wikimedia.org/r/319332

gerritbot added a comment.Nov 2 2016, 3:13 PM

Change 319332 merged by jenkins-bot:
mediawiki-core-jsduck-publish migrate to Nodepool

https://gerrit.wikimedia.org/r/319332

gerritbot added a comment.Nov 4 2016, 1:47 PM

Change 319844 had a related patch set uploaded (by Hashar):
Migrate maven jobs to Jessie/Nodepool

https://gerrit.wikimedia.org/r/319844

gerritbot added a comment.Nov 4 2016, 1:49 PM

Change 319844 merged by jenkins-bot:
Migrate maven jobs to Jessie/Nodepool

https://gerrit.wikimedia.org/r/319844

hashar updated the task description. (Show Details)Nov 4 2016, 2:01 PM
gerritbot added a comment.Nov 7 2016, 10:44 AM

Change 319324 merged by jenkins-bot:
php-compile experimental jobs on Nodepool

https://gerrit.wikimedia.org/r/319324

hashar updated the task description. (Show Details)Jan 10 2017, 11:33 AM
hashar updated the task description. (Show Details)Mar 13 2017, 4:57 PM

selenium-* jobs are now on their own label / dedicated slaves.

hashar moved this task from Backlog to In-progress on the Continuous-Integration-Scaling board.Mar 13 2017, 5:09 PM
gerritbot added a comment.Mar 13 2017, 9:01 PM

Change 342508 had a related patch set uploaded (by Hashar):
[integration/config] Migrate mw-tools-scap-tox-doc-publish to Nodepool

https://gerrit.wikimedia.org/r/342508

gerritbot added a comment.Mar 13 2017, 9:02 PM

Change 342508 merged by jenkins-bot:
[integration/config] Migrate mw-tools-scap-tox-doc-publish to Nodepool

https://gerrit.wikimedia.org/r/342508

gerritbot added a comment.Mar 13 2017, 9:24 PM

Change 342515 had a related patch set uploaded (by Hashar):
[integration/config] Migrate apps-android-java-mwapi to nodepool

https://gerrit.wikimedia.org/r/342515

gerritbot added a comment.Mar 13 2017, 9:25 PM

Change 342515 merged by jenkins-bot:
[integration/config] Migrate apps-android-java-mwapi to nodepool

https://gerrit.wikimedia.org/r/342515

hashar created subtask T160394: Replace job translatewiki-shelllint and have its functionality invoked from composer.Mar 14 2017, 8:54 AM
hashar updated the task description. (Show Details)Mar 14 2017, 10:21 AM
gerritbot added a comment.Mar 14 2017, 11:32 AM

Change 342604 had a related patch set uploaded (by Hashar):
[operations/puppet] Migrate typos check to a rake task

https://gerrit.wikimedia.org/r/342604

hashar closed subtask T160394: Replace job translatewiki-shelllint and have its functionality invoked from composer as Resolved.Mar 14 2017, 3:37 PM
gerritbot added a comment.Mar 23 2017, 5:38 PM

Change 342604 merged by Filippo Giunchedi:
[operations/puppet@production] Migrate typos check to a rake task

https://gerrit.wikimedia.org/r/342604

gerritbot added a comment.Mar 23 2017, 5:55 PM

Change 344444 had a related patch set uploaded (by Hashar):
[integration/config@master] Delete operations-puppet-typos

https://gerrit.wikimedia.org/r/344444

gerritbot added a comment.Mar 23 2017, 8:50 PM

Change 344444 merged by jenkins-bot:
[integration/config@master] Delete operations-puppet-typos

https://gerrit.wikimedia.org/r/344444

hashar mentioned this in T119138: [keyresult] Migrate majority of CI jobs to Nodepool (part 2).Mar 27 2017, 9:39 AM
EddieGP updated the task description. (Show Details)Mar 28 2017, 11:54 AM
hashar updated the task description. (Show Details)Mar 31 2017, 9:45 AM
EddieGP updated the task description. (Show Details)Apr 7 2017, 7:56 PM
hashar updated the task description. (Show Details)May 1 2017, 8:09 PM
greg added a project: Release-Engineering-Team.May 20 2017, 3:53 PM
greg moved this task from INBOX to Epics (ARCHIVED) on the Release-Engineering-Team board.May 20 2017, 3:53 PM
gerritbot added a comment.Jul 26 2017, 2:13 PM

Change 319331 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] Move wikimedia-fundraising-civicrm to Nodepool

https://gerrit.wikimedia.org/r/319331

hashar added a subtask: T171724: wikimedia-fundraising-civicrm fails with Call to a member function getDriver() on null in phar:///srv/jenkins-workspace/workspace/wikimedia-fundraising-civicrm/src/wikimedia/fundraising/civicrm-buildkit/bin/amp/src/Amp/Database/MySQL.php on line 58.Jul 26 2017, 2:13 PM
gerritbot added a comment.Jul 27 2017, 8:27 AM

Change 319331 merged by jenkins-bot:
[integration/config@master] Move wikimedia-fundraising-civicrm to Nodepool

https://gerrit.wikimedia.org/r/319331

gerritbot added a comment.Jul 27 2017, 8:39 AM

Change 368145 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] Revert "Move wikimedia-fundraising-civicrm to Nodepool"

https://gerrit.wikimedia.org/r/368145

gerritbot added a comment.Jul 27 2017, 8:42 AM

Change 368148 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] wikimedia-fundraising-civicrm-jessie as experimental job

https://gerrit.wikimedia.org/r/368148

gerritbot added a comment.Jul 27 2017, 8:45 AM

Change 368145 merged by jenkins-bot:
[integration/config@master] Revert "Move wikimedia-fundraising-civicrm to Nodepool"

https://gerrit.wikimedia.org/r/368145

gerritbot added a comment.Jul 27 2017, 8:46 AM

Change 368148 merged by jenkins-bot:
[integration/config@master] wikimedia-fundraising-civicrm-jessie as experimental job

https://gerrit.wikimedia.org/r/368148

hashar added a comment.Jul 27 2017, 8:47 AM

I blindly switched the wikimedia-fundraising-civicrm job to the Nodepool disposable instances however it is failing due to a missing org.wikimedia.omnimail 

++++ cat sites/default/enabled_modules
+++ drush -y en advanced_help adyen_audit amazon_audit astropay_audit banner_history civicrm contribution_tracking ctools environment_indicator exchange_rates ganglia_reporter globalcollect_audit ingenico_audit large_donation libraries oauth_common oauth_common_providerui offline2civicrm oneoffs queue2civicrm recurring recurring_globalcollect rest_server services services_oauth thank_you wmf_audit wmf_campaigns wmf_civicrm wmf_common wmf_communication wmf_fredge_qc wmf_logging wmf_refund_qc wmf_reports wmf_unsubscribe_qc
PHP Deprecated:  Comments starting with '#' are deprecated in /etc/php5/cli/conf.d/20-xhprof.ini on line 2 in Unknown on line 0
The following extensions will be enabled: advanced_help, adyen_audit, amazon_audit, astropay_audit, banner_history, civicrm, contribution_tracking, ctools, environment_indicator, exchange_rates, ganglia_reporter, globalcollect_audit, ingenico_audit, large_donation, libraries, oauth_common, oauth_common_providerui, offline2civicrm, oneoffs, queue2civicrm, recurring, recurring_globalcollect, rest_server, services, services_oauth, thank_you, wmf_audit, wmf_campaigns, wmf_civicrm, wmf_common, wmf_communication, wmf_fredge_qc, wmf_logging, wmf_refund_qc, wmf_reports, wmf_unsubscribe_qc
Do you really want to continue? (y/n): y
WD php: CiviCRM_API3_Exception: Unknown extension:                       [error]
org.wikimedia.omnimail in civicrm_api3() (line 45 of
/home/jenkins/workspace/wikimedia-fundraising-civicrm-jessie/src/wikimedia/fundraising/crm/civicrm/api/api.php).

Full console log captured as P5807

I have restored the previous job and the nodepool job (suffixed with -jessie) is now in the experimental pipeline and thus can be triggered manually by commenting in Gerrit check experimental.

Ejegg closed subtask T171724: wikimedia-fundraising-civicrm fails with Call to a member function getDriver() on null in phar:///srv/jenkins-workspace/workspace/wikimedia-fundraising-civicrm/src/wikimedia/fundraising/civicrm-buildkit/bin/amp/src/Amp/Database/MySQL.php on line 58 as Resolved.Sep 25 2017, 7:34 PM
hashar closed this task as Resolved.Feb 8 2018, 7:57 AM
hashar claimed this task.

This has been mostly done. The long tail of jobs still on permanent slaves will end up being migrated to Docker containers since Nodepool is now legacy.

EddieGP mentioned this in T192217: Remove the "check" pipeline and Zuul's user-filter.Apr 14 2018, 8:09 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits