Page MenuHomePhabricator
Create Task
Maniphest T126991

Migrate services CI jobs to node 4.3
Closed, ResolvedPublic
Actions

Description

This is a Tracking-Neverending task.

Node 4.3 is available on Nodepool instances. It is time to carefully switch the various services to it (from Trusty and node 0.10.x). We have to migrate the source and deploy repositories jobs from the npm / XX-deploy-npm jobs to the new npm-node-4.3 and XX-deploy-npm-4.3 jobs.

In some cases, the deploy repository does not have any job which might prove challenging since the CI configuration is a bit scary (for deploy repos, the dev dependencies are injected from the source repo and a symlink package.json -> src/package.json needs to be present).

Summary of services under mediawiki/services that are defined in CI as of Feb. 15th 2016:

citoid ok deploy okhttps://gerrit.wikimedia.org/r/#/c/271789/
cxserver okdeploy okT127447: Migrate cxserver CI jobs to nodeJs 4.3
graphoid okdeploy okT106668: Enable jenkins test & submit for graphoid repo
mathoid okdeploy okT124447: Enable node4 for mathoid tests (mathoid/deploy tests fail)
mobileapps okdeploy okT126995: Migrate mediawiki/services/mobileapps CI jobs from node 0.10 to 4.3
parsoid okdeploy okT126992: Migrate Parsoid CI jobs to Nodepool and add Node 4.3 support

Details

SubjectRepoBranchLines +/-
citoid/deploy: add node 4.3 jobintegration/configmaster+13 -0
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedhasharT119138 [keyresult] Migrate majority of CI jobs to Nodepool (part 2)
 DuplicateNoneT136249 Track what tests we have left to convert to nodepool
 ResolvedhasharT119140 [keyresult] Migrate as many misc CI jobs as possible to Nodepool
 ResolvedhasharT114315 [keyresult] Migrate majority of CI jobs to Nodepool (part 1)
 DuplicateNoneT126774 Run 'npm' job with Node 4 (instead of Node 0.10)
 ResolvedKrinkleT129617 Jobs sometimes fail with "/usr/local/bin/npm: No such file or directory"
 ResolvedhasharT119143 Migrate javascript npm CI jobs to Nodepool
 Resolved• mobrovacT124989 Move all Node.JS services to Jessie and Node 4
 ResolvedhasharT126991 Migrate services CI jobs to node 4.3
 ResolvedhasharT106668 Enable jenkins test & submit for graphoid repo
 Resolved• mobrovacT119693 Extract Graphoid Debian packages dependencies to a standalone puppet class so they can be installed on CI slaves
 ResolvedhasharT129092 Hiera is not properly configured on Nodepool instances
 ResolvedhasharT126230 Provision pkg-config on Nodepool instances
 Resolved• mobrovacT124447 Enable node4 for mathoid tests (mathoid/deploy tests fail)
 ResolvedhasharT126246 Provision openjdk-7-jre-headless on Nodepool slaves
 DuplicateNoneT129880 Give @mobrovac access to CI instances
 ResolvedhasharT126992 Migrate Parsoid CI jobs to Nodepool and add Node 4.3 support
 ResolvedhasharT124474 Package npm 2.14
 ResolvedhasharT109005 Switch CI from jsduck deb package to a gemfile/bundler system
 ResolvedhasharT136096 Create jsduck job that runs on Nodepool instances
 ResolvedhasharT126995 Migrate mediawiki/services/mobileapps CI jobs from node 0.10 to 4.3
 ResolvedhasharT127447 Migrate cxserver CI jobs to nodeJs 4.3

Event Timeline

hashar created this task.Feb 15 2016, 4:53 PM
hashar claimed this task.
hashar raised the priority of this task from to Medium.
hashar updated the task description. (Show Details)
hashar added projects: Patch-For-Review, NewFunctionality-Worktype, Continuous-Integration-Scaling, Services, Tracking-Neverending.
hashar added subtasks: T106668: Enable jenkins test & submit for graphoid repo, T124447: Enable node4 for mathoid tests (mathoid/deploy tests fail).
hashar added a parent task: T124989: Move all Node.JS services to Jessie and Node 4.
hashar added subscribers: Stashbot, Krinkle, Jdforrester-WMF and 8 others.
Ricordisamoa added a subscriber: Ricordisamoa.Feb 15 2016, 4:58 PM
hashar updated the task description. (Show Details)Feb 15 2016, 4:59 PM
hashar set Security to None.
Danny_B removed a project: Patch-For-Review.Feb 15 2016, 5:02 PM
hashar closed subtask T126995: Migrate mediawiki/services/mobileapps CI jobs from node 0.10 to 4.3 as Resolved.Feb 15 2016, 5:45 PM
hashar updated the task description. (Show Details)
hashar moved this task from Backlog to In-progress on the Continuous-Integration-Scaling board.Feb 15 2016, 10:30 PM
hashar created subtask T127447: Migrate cxserver CI jobs to nodeJs 4.3.Feb 19 2016, 2:49 PM
hashar closed subtask T127447: Migrate cxserver CI jobs to nodeJs 4.3 as Resolved.Feb 19 2016, 2:59 PM
hashar updated the task description. (Show Details)
gerritbot added a comment.Feb 19 2016, 3:02 PM

Change 271789 had a related patch set uploaded (by Hashar):
citoid/deploy: add node 4.3 job

https://gerrit.wikimedia.org/r/271789

gerritbot added a project: Patch-For-Review.Feb 19 2016, 3:02 PM
gerritbot added a comment.Feb 19 2016, 3:05 PM

Change 271789 merged by jenkins-bot:
citoid/deploy: add node 4.3 job

https://gerrit.wikimedia.org/r/271789

hashar updated the task description. (Show Details)Feb 19 2016, 3:07 PM

I have migrated cxserver (got switched to scb and NodeJS 4.3 on Wednesday).

Added NodeJS 4.3 job for citoid/deploy which pass.

hashar added a comment.Feb 19 2016, 5:13 PM

Status:

Parsoid, gotta follow up on T126992 and find out a good overhaul of the current jobs.

Graphoid (T106668) is pending puppet work on T119693 which impact production.

hashar changed the status of subtask T106668: Enable jenkins test & submit for graphoid repo from Stalled to Open.Mar 10 2016, 12:47 PM
hashar closed subtask T106668: Enable jenkins test & submit for graphoid repo as Resolved.Mar 10 2016, 1:08 PM
hashar updated the task description. (Show Details)
hashar added a comment.Mar 10 2016, 1:11 PM

Status update

Graphoid has NodeJs 4.3 jobs on both source and deploy repositories.

Mathoid deploy repo still fail for random reason: T124447

Mathoid can starts using librsvg which is now provided on the Nodepool instances

I haven't looked at Parsoid yet beside the initial task filling T126992

hashar removed a project: Patch-For-Review.Mar 10 2016, 1:12 PM
• mobrovac changed the status of subtask T124447: Enable node4 for mathoid tests (mathoid/deploy tests fail) from Open to Stalled.Mar 14 2016, 9:59 AM
• mobrovac closed subtask T124447: Enable node4 for mathoid tests (mathoid/deploy tests fail) as Resolved.Mar 15 2016, 2:42 PM
hashar updated the task description. (Show Details)Mar 15 2016, 2:46 PM
Krinkle removed a subscriber: Krinkle.Mar 17 2016, 12:28 AM
hashar changed the status of subtask T126992: Migrate Parsoid CI jobs to Nodepool and add Node 4.3 support from Open to Stalled.Apr 1 2016, 3:26 PM
hashar changed the status of subtask T126992: Migrate Parsoid CI jobs to Nodepool and add Node 4.3 support from Stalled to Open.Apr 1 2016, 9:44 PM
hashar updated the task description. (Show Details)May 25 2016, 8:58 AM
hashar closed this task as Resolved.May 25 2016, 8:07 PM
hashar closed subtask T126992: Migrate Parsoid CI jobs to Nodepool and add Node 4.3 support as Resolved.
hashar updated the task description. (Show Details)

All identified repositories have been migrated. Parsoid has been done a minute or so ago T126992.

There are still services not running jobs, but that is/would be covered by other tasks.

Danny_B moved this task from Tag to Should be Goal instead on the Tracking-Neverending board.Jul 11 2016, 6:54 PM
• Phabricator_maintenance added a project: Goal.Aug 13 2016, 8:41 PM
• Phabricator_maintenance renamed this task from [tracking] Migrate services CI jobs to node 4.3 to Migrate services CI jobs to node 4.3.Aug 13 2016, 9:08 PM
• Phabricator_maintenance removed a project: Tracking-Neverending.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL