Experiment with using pnpm in CI to speed up npm install process
Open, Needs TriagePublic
Actions

Assigned To

None

Authored By

	kostajh
	Apr 6 2022, 8:47 AM

Description

It's supposed to be a lot faster [citation needed].

AFAICS, the steps needed are:

Update the docker images to install pnpm with curl https://pnpm.io/installation
Update Quibble to use pnpm instead of npm
Replace some commands like 'ci' and 'prune' with pnpm equivalents
Make sure pnpm's cache is saved to a place that gets restored across jobs https://pnpm.io/continuous-integration

Details

Subject	Repo	Branch	Lines +/-
dockerfiles: Install pnpm in Quibble images	integration/config	master	+64 -0
jjb: Switch quibble jobs to 1.4.6	integration/config	master	+33 -33
dockerfiles: update to Quibble 1.4.6	integration/config	master	+68 -4
release: Quibble 1.4.6	integration/quibble	master	+18 -2
test: run tests with different values of NPM_COMMAND	integration/quibble	master	+67 -25
npm: Allow overriding command	integration/quibble	master	+39 -12

Customize query in gerrit

Related Objects

Mentioned In: T316601: PHP Warning: Erroneous data format for unserializing 'Wikimedia\Rdbms\MySQLPrimaryPos'
T314586: Enable Wikibase CI wikis to link to themselves
Mentioned Here: T316601: PHP Warning: Erroneous data format for unserializing 'Wikimedia\Rdbms\MySQLPrimaryPos'
T314586: Enable Wikibase CI wikis to link to themselves

Event Timeline

kostajh created this task.Apr 6 2022, 8:47 AM

kostajh moved this task from Backlog to Enhancement on the Quibble board.May 12 2022, 9:12 AM

Change 813214 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[integration/quibble@master] npm: Allow overriding command

https://gerrit.wikimedia.org/r/813214

gerritbot added a project: Patch-For-Review.Jul 12 2022, 10:32 AM

Change 813215 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[integration/config@master] dockerfiles: Install pnpm in Quibble images

https://gerrit.wikimedia.org/r/813215

Change 824709 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/quibble@master] test: run tests with different values of NPM_COMMAND

https://gerrit.wikimedia.org/r/824709

Change 813214 merged by jenkins-bot:

[integration/quibble@master] npm: Allow overriding command

https://gerrit.wikimedia.org/r/813214

Change 824709 merged by jenkins-bot:

[integration/quibble@master] test: run tests with different values of NPM_COMMAND

https://gerrit.wikimedia.org/r/824709

Change 828561 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/quibble@master] release: Quibble 1.4.6

https://gerrit.wikimedia.org/r/828561

Change 828574 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] dockerfiles: update to Quibble 1.4.6

https://gerrit.wikimedia.org/r/828574

Change 828561 merged by jenkins-bot:

[integration/quibble@master] release: Quibble 1.4.6

https://gerrit.wikimedia.org/r/828561

Mentioned in SAL (#wikimedia-releng) [2022-08-31T16:18:34Z] <hashar> Tag Quibble 1.4.6 @ 8828487d0 # T305525 T314586

Change 828574 merged by jenkins-bot:

[integration/config@master] dockerfiles: update to Quibble 1.4.6

https://gerrit.wikimedia.org/r/828574

Change 828611 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] jjb: Switch quibble jobs to 1.4.6

https://gerrit.wikimedia.org/r/828611

Change 828611 merged by jenkins-bot:

[integration/config@master] jjb: Switch quibble jobs to 1.4.6

https://gerrit.wikimedia.org/r/828611

Mentioned in SAL (#wikimedia-releng) [2022-09-01T07:43:51Z] <hashar> Updating Jenkins jobs for Quibble 1.4.5 > 1.4.6 + php 7.4 update | T305525 | T314586 | T316601 | https://gerrit.wikimedia.org/r/c/integration/config/+/828611

@hashar should we move this forward? I think we need to build new images with pnpm installed (https://gerrit.wikimedia.org/r/c/integration/config/+/813215) in order to test it out.

DDeSouza subscribed.Jul 20 2023, 12:33 AM

Change 813215 abandoned by Hashar: