Page MenuHomePhabricator
Create Task
Maniphest T326372

Update CI config for new fundraising/REL1_39 branch of mediawiki/core under php7.4
Closed, ResolvedPublic
Actions

Description

I put up a WIP to add fundraising/REL1_39 config to jjb/wm-fundraising.yaml and jjb/php.yaml, but it needs some more work to actually run the right tests.

https://gerrit.wikimedia.org/r/876010

In zuul/layout.yaml the fundraising specific gate and test suites are defined to use php73 images. I'd love any suggestions or patch edits from the release engineering team to let us run tests against fundraising/REL1_39 with the php7.4 images while still using php73 (for the next week or so) on the fundraising/REL1_35 branch.

For the last upgrade we needed to maintain a special branch of DonationInterface during the transition, but for this upgrade it seems only one patch is necessary, and that one is backwards compatible with REL1_35.

Details

ProjectBranchLines +/-Subject
integration/configmaster+6 -6Zuul: Switch FR things on mwgate-composer-php73-docker to php74
integration/configmaster+0 -15jjb: Drop fundraising/REL1_35 jobs, no longer used
integration/configmaster+7 -22Zuul: Drop fundraising/REL1_35 jobs, everything has moved to REL1_39 now
integration/configmaster+1 -5[DNM] Zuul: [wikimedia/fundraising/SmashPig] Drop PHP73 testing
integration/configmaster+9 -8Zuul: Make fundraising/REL1_39 jobs voting
integration/configmaster+2 -0Zuul: [mediawiki/extensions/DonationInterface] Add REL1_39 exp. job
integration/configmaster+5 -0Zuul: Skip quibble-donationinterface-REL1_39-php74-docker on deployment branch
integration/configmaster+7 -0Zuul: Add experimental jobs for fundraising/REL1_39
integration/configmaster+13 -0jjb: Add test jobs for fundraising/REL1_39
Customize query in gerrit

Related Objects
Search...

Event Timeline

Ejegg created this task.Thu, Jan 5, 11:53 PM
Restricted Application removed a project: Patch-For-Review. · View Herald TranscriptThu, Jan 5, 11:53 PM
gerritbot added a comment.Thu, Jan 5, 11:53 PM

Change 876010 had a related patch set uploaded (by Ejegg; author: Ejegg):

[integration/config@master] WIP add test jobs for fundraising/REL1_39

https://gerrit.wikimedia.org/r/876010

gerritbot added a project: Patch-For-Review.Thu, Jan 5, 11:53 PM
gerritbot added a comment.Mon, Jan 9, 8:00 PM

Change 877253 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] Zuul: Add experimental jobs for fundraising/REL1_39

https://gerrit.wikimedia.org/r/877253

gerritbot added a comment.Mon, Jan 9, 8:01 PM

Change 876010 merged by jenkins-bot:

[integration/config@master] jjb: Add test jobs for fundraising/REL1_39

https://gerrit.wikimedia.org/r/876010

XenoRyet moved this task from Triage to Current Sprint on the Fundraising-Backlog board.Mon, Jan 9, 8:32 PM
gerritbot added a comment.Tue, Jan 10, 3:27 PM

Change 877253 merged by jenkins-bot:

[integration/config@master] Zuul: Add experimental jobs for fundraising/REL1_39

https://gerrit.wikimedia.org/r/877253

Stashbot added a comment.Tue, Jan 10, 3:28 PM

Mentioned in SAL (#wikimedia-releng) [2023-01-10T15:28:13Z] <James_F> Zuul: Add experimental jobs for fundraising/REL1_39 for T326372

gerritbot added a comment.Tue, Jan 10, 3:58 PM

Change 878119 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] Zuul: Skip quibble-donationinterface-REL1_39-php74-docker on deployment branch

https://gerrit.wikimedia.org/r/878119

gerritbot added a comment.Tue, Jan 10, 3:58 PM

Change 878120 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] [DNM] Zuul: Make fundraising/REL1_39 jobs voting

https://gerrit.wikimedia.org/r/878120

gerritbot added a comment.Tue, Jan 10, 3:58 PM

Change 878121 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] [DNM] Zuul: Drop fundraising/REL1_35 jobs, everything has moved to REL1_39 now

https://gerrit.wikimedia.org/r/878121

gerritbot added a comment.Tue, Jan 10, 3:58 PM

Change 878122 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] [DNM] Zuul: [wikimedia/fundraising/SmashPig] Drop PHP73 testing

https://gerrit.wikimedia.org/r/878122

gerritbot added a comment.Tue, Jan 10, 3:58 PM

Change 878123 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] [DNM] jjb: Drop fundraising/REL1_35 jobs, no longer used

https://gerrit.wikimedia.org/r/878123

gerritbot added a comment.Tue, Jan 10, 4:27 PM

Change 878119 merged by jenkins-bot:

[integration/config@master] Zuul: Skip quibble-donationinterface-REL1_39-php74-docker on deployment branch

https://gerrit.wikimedia.org/r/878119

gerritbot added a comment.Tue, Jan 10, 4:34 PM

Change 878130 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] Zuul: [mediawiki/extensions/DonationInterface] Add REL1_39 exp. job

https://gerrit.wikimedia.org/r/878130

gerritbot added a comment.Tue, Jan 10, 4:40 PM

Change 878130 merged by jenkins-bot:

[integration/config@master] Zuul: [mediawiki/extensions/DonationInterface] Add REL1_39 exp. job

https://gerrit.wikimedia.org/r/878130

Jdforrester-WMF added a subscriber: Jdforrester-WMF.Tue, Jan 10, 4:54 PM

OK, the new PHP74/REL1_39 jobs should be available in all five relevant repos (MW itself plus the DonationInterface, cldr, FundraisingEmailUnsubscribe, and ParserFunctions) as experimental jobs.

Once those are tested and found to be passing, we can make those jobs voting so it doesn't regress, and the FR stack can be migrated.

Once you have no need to maintain compatibility with PHP73/REL1_35, this removes those jobs from all five MW things, this removes PHP73 testing from the SmashPig library, and finally this just cleans things up.

Hope this helps!

Ejegg moved this task from Backlog to Pending Deployment on the Fundraising Sprint Amazing grep board.Tue, Jan 10, 8:34 PM
AnnWF moved this task from Pending Deployment to Blocked in sprint (not fr-tech) on the Fundraising Sprint Amazing grep board.Wed, Jan 11, 9:10 PM
XenoRyet added a project: Fundraising Sprint Bridge over troubled Wifi.Tue, Jan 17, 9:18 PM
Ejegg moved this task from Backlog to Blocked in sprint (not fr-tech) on the Fundraising Sprint Bridge over troubled Wifi board.Tue, Jan 17, 9:52 PM
Ejegg added a comment.Tue, Jan 24, 9:30 PM

Thanks, @Jdforrester-WMF! We are hoping to go ahead and upgrade the payments servers to Mediawiki 1.39 tomorrow. We should be able to remove REL1_35 compatibility at the same time as we make those jobs voting, since we won't be running the two versions in parallel. I'll +1 the patches to indicate we're ready for 'em.

Jdforrester-WMF added a comment.Tue, Jan 24, 9:42 PM
In T326372#8555129, @Ejegg wrote:

Thanks, @Jdforrester-WMF! We are hoping to go ahead and upgrade the payments servers to Mediawiki 1.39 tomorrow. We should be able to remove REL1_35 compatibility at the same time as we make those jobs voting, since we won't be running the two versions in parallel. I'll +1 the patches to indicate we're ready for 'em.

Awesome, happy to deploy as soon as you need.

gerritbot added a comment.Tue, Jan 24, 10:04 PM

Change 878120 merged by jenkins-bot:

[integration/config@master] Zuul: Make fundraising/REL1_39 jobs voting

https://gerrit.wikimedia.org/r/878120

Stashbot added a comment.Tue, Jan 24, 10:04 PM

Mentioned in SAL (#wikimedia-releng) [2023-01-24T22:04:54Z] <James_F> Zuul: Make fundraising/REL1_39 jobs voting for T326372

gerritbot added a comment.Tue, Jan 24, 10:07 PM

Change 878121 merged by jenkins-bot:

[integration/config@master] Zuul: Drop fundraising/REL1_35 jobs, everything has moved to REL1_39 now

https://gerrit.wikimedia.org/r/878121

Stashbot added a comment.Tue, Jan 24, 10:08 PM

Mentioned in SAL (#wikimedia-releng) [2023-01-24T22:08:34Z] <James_F> Zuul: Drop fundraising/REL1_35 jobs, everything has moved to REL1_39 now T326372

Jdforrester-WMF added a comment.Tue, Jan 24, 10:13 PM
In T326372#8555155, @Jdforrester-WMF wrote:
In T326372#8555129, @Ejegg wrote:

Thanks, @Jdforrester-WMF! We are hoping to go ahead and upgrade the payments servers to Mediawiki 1.39 tomorrow. We should be able to remove REL1_35 compatibility at the same time as we make those jobs voting, since we won't be running the two versions in parallel. I'll +1 the patches to indicate we're ready for 'em.

Awesome, happy to deploy as soon as you need.

I deployed the switch-over but https://gerrit.wikimedia.org/r/c/mediawiki/extensions/DonationInterface/+/879689 (latest merged patch on master) failed its run – https://integration.wikimedia.org/ci/job/quibble-donationinterface-REL1_39-php74-docker/3/console

00:01:23.792 1) SpecialPageFatalTest::testSpecialPageDoesNotFatal
00:01:23.802 Error: Call to a member function getAccountConfig() on null
00:01:23.802 
00:01:23.802 /workspace/src/extensions/DonationInterface/dlocal_gateway/dlocal_gateway.body.php:15

Do I need to roll back, or is this something you know about?

Ejegg added a comment.Tue, Jan 24, 10:41 PM

Hi @Jdforrester-WMF that was a legitimate error in the code under test - we've fixed it in a follow-on patch!

Ejegg added a comment.Tue, Jan 24, 10:42 PM

And thanks very much for the speedy config updates :)

gerritbot added a comment.Tue, Jan 24, 10:52 PM

Change 878123 merged by jenkins-bot:

[integration/config@master] jjb: Drop fundraising/REL1_35 jobs, no longer used

https://gerrit.wikimedia.org/r/878123

Jdforrester-WMF closed this task as Resolved.Tue, Jan 24, 10:53 PM

OK, I think we can declare this Resolved then. Please shout if you lot need anything! :-)

Ejegg reopened this task as Open.Tue, Jan 31, 4:15 AM

Hi @Jdforrester-WMF , we're still seeing some test failures on the fundraising/REL1_39 branch of mediawiki/vendor when it tries to run under PHP7.3 - could you please help us get those last tests running under PHP7.4 as well? I took a brief look at the zuul config but the place to fix didn't jump out at me.

Ejegg added a comment.Tue, Jan 31, 4:16 AM

Example failure (overridden with a manual V+2): https://gerrit.wikimedia.org/r/c/mediawiki/vendor/+/883688

Jdforrester-WMF added a comment.Tue, Jan 31, 5:58 PM
In T326372#8573065, @Ejegg wrote:

Hi @Jdforrester-WMF , we're still seeing some test failures on the fundraising/REL1_39 branch of mediawiki/vendor when it tries to run under PHP7.3 - could you please help us get those last tests running under PHP7.4 as well? I took a brief look at the zuul config but the place to fix didn't jump out at me.

Oh, oops, yes, missed a few configs! One sec.

gerritbot added a comment.Tue, Jan 31, 6:02 PM

Change 885396 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] Zuul: Switch FR things on mwgate-composer-php73-docker to php74

https://gerrit.wikimedia.org/r/885396

gerritbot added a comment.Tue, Jan 31, 6:05 PM

Change 885396 merged by jenkins-bot:

[integration/config@master] Zuul: Switch FR things on mwgate-composer-php73-docker to php74

https://gerrit.wikimedia.org/r/885396

Stashbot added a comment.Tue, Jan 31, 6:06 PM

Mentioned in SAL (#wikimedia-releng) [2023-01-31T18:06:39Z] <James_F> Zuul: Switch FR things on mwgate-composer-php73-docker to php74 for T326372

Jdforrester-WMF added a comment.Tue, Jan 31, 6:08 PM
In T326372#8575633, @Jdforrester-WMF wrote:
In T326372#8573065, @Ejegg wrote:

Hi @Jdforrester-WMF , we're still seeing some test failures on the fundraising/REL1_39 branch of mediawiki/vendor when it tries to run under PHP7.3 - could you please help us get those last tests running under PHP7.4 as well? I took a brief look at the zuul config but the place to fix didn't jump out at me.

Oh, oops, yes, missed a few configs! One sec.

OK, this should now be done. There's still wikimedia/fundraising/crm (and T307178: CiviCRM CI jobs fails when migrating from Stretch to Bullseye in particular) to switch in the FR world, alongside SmashPig, but I believe that this can be re-closed unless you run into anything else?

XenoRyet added a project: Fundraising Sprint Can't touch $this.Tue, Jan 31, 9:31 PM
AnnWF moved this task from Backlog to Ready for Review on the Fundraising Sprint Can't touch $this board.Wed, Feb 1, 5:07 PM
Ejegg added a comment.Wed, Feb 1, 9:53 PM

Thanks again, @Jdforrester-WMF ! We're seeing the vendor tests run on the correct version now. In my latest mediawiki/vendor patch on fundraising/REL1_39 I am seeing some test failures in the MWTimestampTest::testHumanTimestamp https://integration.wikimedia.org/ci/job/quibble-donationinterface-REL1_39-php74-docker/76/console

I guess we should re-close this ticket and I can open a new one for that test.

Ejegg closed this task as Resolved.Wed, Feb 1, 9:53 PM
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL