In https://gerrit.wikimedia.org/r/#/c/93939/ I made the beta autoupdater to run npm install under common/php-master/extensions/Parsoid/js

Regardless, the parsoid instance is deployment-parsoid2 and runs its own copy of the code under /srv/deployment/parsoid . So it is still being updated manually by whoever has access on it.

The whole point of beta is to test the tips of master branches from all extensions. That let us catch potential issue before all those tips are aggregated in a wmf branch. To prevent new code from being executed, we use feature switching ($wgFeatureXXX = false) that still let us deploy the code and enable it selectively later on.

That being said, I think it would make sense to run VisualEditor and Parsoid on the tip of master. That would probably help you detect possible breakage when deploying.

For the sake of clarification: I am open to any solution :)

• Bug 56670 has been marked as a duplicate of this bug. ***

Usually Parsoid master will work fine with VE. DOM spec changes have not been frequent in the past, and will get even less frequent over time. Empirically, the main source of issues has been a lack of integration testing rather than existing functionality breaking because of incompatibilities.

So if we could only set up one version for now I'd prioritize testing against master over testing against an older version of Parsoid, in particular if that is not updated automatically. Much of the VE integration testing is also still manual at this point, which makes focusing on the most likely source of errors even more important.

What we could potentially do in Jenkins:

Whenever a change is send on VisualEditor, we could somehow boot up two Parsoid instances running master and production versions then run the VisualEditor tests against each of them.

Similarly, whenever a change is send to Parasoid, we could create an instance of it and run VisualEditor tests from master and production versions.

That should help both team figuring out potential issues and regressions.

We never achieved such integration tests on any project yet. Ideally we would use labs to boot up instances that would contains all the required dependencies and run the tests there. The infrastructure is not ready yet :-/

(In reply to comment #1)

In https://gerrit.wikimedia.org/r/#/c/93939/ I made the beta autoupdater to
run
npm install under common/php-master/extensions/Parsoid/js

Regardless, the parsoid instance is deployment-parsoid2 and runs its own
copy of the code under /srv/deployment/parsoid . So it is still being updated
manually by whoever has access on it.

Copied that to:

Bug 57233 - beta: Parsoid should continuously deploy master branch

I'm not sure I agree this bug is INVALID; we still can't reliably test master of VisualEditor against production of Parsoid or vice versa; instead, we test master of VisualEditor against master of Parsoid in Beta, and production VisualEditor against production Parsoid in production, and hope that we don't get into one of those situations again where one assumes things about the other…