Page MenuHomePhabricator
Create Task
Maniphest T370934

Build and publish multiple MediaWiki production images for a given set of PHP versions
Closed, ResolvedPublic
Actions

Description

In order to support a progressive rollout of new PHP versions, we need to produce different MediaWiki images for each PHP version.

Our container image build scripts in the release project should support the PHP version as a build argument.

There are two parts to achieving this goal and putting it to use:

  • scap gains the ability to build multiple "flavours" for each image "kind" (mw, web), where the configuration that defines a given flavor at least provides the ability to set the base production image used (e.g., by way of build arguments).
  • scap gains the ability to map an arbitrary number of mw-on-k8s helmfile releases within a given k8s namespace to the image flavours they should use, and this information is published for consumption by helmfile via values files in /etc/helmfile-defaults/mediawiki/release.

See also T370934#10104089 for more detailed discussion on some of these topics.

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
types: remove older Mediawiki_deployment variantoperations/puppetproduction+11 -21
hieradata: convert remaining mw_releases entriesoperations/puppetproduction+24 -14
hieradata: use 'releases' in mw-debug mw_releasesoperations/puppetproduction+2 -2
types: extend Profile::Mediawiki_deploymentoperations/puppetproduction+21 -8
Customize query in gerrit
Related Changes in GitLab:
TitleReferenceAuthorSource BranchDest Branch
make-container-image: Parallelize image buildsrepos/releng/release!135dduvallmain-7ac5-7ac5main-7ac5-d0c7
build-images.py: Build multiple flavours of each imagerepos/releng/release!133dduvallmain-7ac5-7a7cmain
kubernetes: Support deployment of image flavoursrepos/releng/scap!520dduvallreview/flavors-08a0master
build-images.py: Build multiple flavours of each imagerepos/releng/release!129dduvallmain-7a7cmain
kubernetes: drop older DeploymentsConfig supportrepos/releng/scap!484swfrenchwork/swfrench/T370934-cleanupmaster
Update mediawiki-deployments.yaml to new formatrepos/releng/train-dev!95swfrenchwork/swfrench/T370934-mediawiki-deploymentsmain
kubernetes: generalize deployments configurationrepos/releng/scap!462swfrenchwork/swfrench/T370934-mediawiki-deploymentsmaster
Customize query in GitLab

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedNoneT396296 Upgrade symfony/* to PHP 8.1 versions
 ResolvedReedyT373753 Drop symfony/polyfill-php 73-81 from mediawiki-vendor
 StalledNoneT255792 Quibble runs core:unit tests twice!
 OpenNoneT376276 PHP 8.4: Implicitly nullable parameter declarations deprecated
 OpenNoneT379587 PHP 8.4: Implicitly nullable parameter declarations deprecated in 3rd party vendor libs
 ResolvedReedyT378424 PHP 8.4: Implicitly nullable parameter declarations deprecated in qrcode vendor libs
 OpenNoneT358666 Drop PHP 8.1 support from MediaWiki
 OpenKrinkleT360995 Migrate Wikimedia production from PHP 8.1 to PHP 8.3
 ResolvedJdforrester-WMFT353362 Make PHP 8.3 voting on development (master) branch of MW ecosystem (core, vendor, extensions, skins, libraries)
 ResolvedJdforrester-WMFT352085 Make PHP 8.2 voting on development (master) branch of MW ecosystem (core, vendor, extensions, skins, libraries)
 ResolvedJdforrester-WMFT360560 Make PHP 8.2 voting on development branch of Wikibase
 ResolvedLucas_Werkmeister_WMDET324202 Remove use of utf8_encode and utf8_decode in Wikibase
 ResolvedNoneT353161 [CLIENT] Creation of dynamic property MediaWiki\Title\Title::$wikibasePushedDeleteToRepo is deprecated
 ResolvedJdforrester-WMFT360709 Make PHP 8.2 voting on development (master) branch of Math extension
 ResolvedDaimonaT381728 Use PHP 8.3 in MediaWiki-Docker
 ResolvedJdforrester-WMFT398491 Move CI images to WMF PHP 8.3 packages
 OpenNoneT401255 Switch PHP 8.3 image of MediaWiki-Docker from Sury to WMF
 ResolvedScott_FrenchT401254 Upgrade mw-debug/next to PHP 8.3
 ResolvedScott_FrenchT401252 Configure title-case consistency mapping for PHP 8.1 -> 8.3 transition
 ResolvedScott_FrenchT399884 Configure production MediaWiki image builds for PHP 8.3
 OpencscottT401855 ☂ PHP 8.3 issues found during WMF rollout
 ResolvedScott_FrenchT402424 PHP Deprecated: Using ${var} in strings is deprecated, use {$var} instead in /srv/monitoring/lib.php on line 99
 DuplicatePRODUCTION ERRORNoneT403514 Expectation (readQueryRows <= 10000) by MediaWiki\Actions\ActionEntryPoint::execute not met (actual: 12860)
 ResolvedPRODUCTION ERRORMichaelT407403 Error: Invalid serialization data for DatePeriod object
 OpenPRODUCTION ERRORNoneT408852 PHP Deprecated: DateTime::__construct(): Passing null to parameter #1 ($datetime) of type string is deprecated
 OpenMichaelT401005 Investigate Production Errors from ComputedUserImpactLookup::getPageViewData
 DuplicatePRODUCTION ERRORNoneT409248 PHP Warning: Trying to access array offset on null
 ResolvedTgrT402597 Exploratory testing on PHP 8.3 for MediaWiki Platform Team components
 ResolvedNoneT402804 Exploratory testing on PHP 8.3 for MediaWiki authentication stack
 ResolvedDAlangi_WMFT403484 Exploratory testing on PHP 8.3 for MediaWiki authentication stack: Login
 ResolvedTgrT403485 Exploratory testing on PHP 8.3 for MediaWiki authentication stack: Central session
 ResolvedDAlangi_WMFT403486 Exploratory testing on PHP 8.3 for MediaWiki authentication stack: Signup
 ResolvedTgrT403487 Exploratory testing on PHP 8.3 for MediaWiki authentication stack: OAuth
 ResolvedTgrT403488 Exploratory testing on PHP 8.3 for MediaWiki authentication stack: 2FA
 ResolvedAtienoT402809 Exploratory testing on PHP 8.3 for MediaWiki Interfaces Team components
 OpenNoneT402810 Exploratory testing on PHP 8.3 for Content Transform Team components
 ResolvedbrouberolT403110 Prepare dumps-on-k8s (mediawiki-dumps-legacy) for migration to PHP 8.3
 ResolvedScott_FrenchT403655 Configure mw-next-routing for the PHP 8.3 migration
 ResolvedScott_FrenchT403657 Configure the WikimediaEvents extension for the PHP 8.3 migration
 ResolvedScott_FrenchT403284 Migrate production Shellbox services to PHP 8.3
 ResolvedScott_FrenchT403283 Prepare PHP 8.3 service images for Shellbox
 ResolvedScott_FrenchT398246 Prepare PHP 8.3 production images
 ResolvedScott_FrenchT398245 Prepare WMF PHP 8.3 packages for bullseye
 ResolvedKrinkleT400109 Ensure MediaWiki-Core-Profiler works with php-xhprof 2.x (PHP 8.3)
 ResolvedKrinkleT401152 Switch wmf-config/Profiler from Tideways to XHProf
 ResolvedScott_FrenchT403772 Migrate parsoidtest1001 to PHP 8.3
 ResolvedKrinkleT405031 lcobucci/clock needs upgrading for PHP 8.3
 ResolvedTgrT363639 web-auth/webauthn-lib must be upgraded to 4+ for PHP 8.2+ support
 ResolvedScott_FrenchT405955 MediaWiki on PHP 8.3 production workload migration
 ResolvedjnucheT411277 Patchdemo wiki creation fails due to PHP 8.1 not supported by MW
 ResolvedJdforrester-WMFT411372 wikilambda-catalyst-end-to-end broken due to new version of composer after PHP 8.1 -> 8.3 migration
 ResolvedBUG REPORT• bd808T411235 Beta cluster scap using php8.1 container; php8.2 is now required
 ResolvedReedyT380185 Prepare for newer geoip2/geoip2 library
 ResolvedReedyT338103 Micro-optimize ApiResult::isMetadataKey with str_starts_with once we support PHP8+
 Resolvedseanleong-WMDET379930 Use WeakMap instead of an array in RestrictedEntityLookupFactory
 StalledNoneT334726 Use return type `never` in Wikibase
 OpenNoneT328919 Upgrade PHPUnit in MediaWiki code to PHPUnit 10
 ResolvedLucas_Werkmeister_WMDET328741 Test failures under PHPUnit 9.6: "Expecting E_DEPRECATED and E_USER_DEPRECATED is deprecated and will no longer be possible in PHPUnit 10"
 ResolvedDaimonaT342110 Upgrade to PHPUnit 9.6
 ResolvedDaimonaT342259 Move MediaWikiIntegrationTestCase setup and teardown away from run()
 ResolvedDaimonaT342301 Remove MediaWikiIntegrationTestCase::$tablesUsed in favour of automatic query tracking
 OpenNoneT332865 PHPUnit data providers should be simple static functions that return plain data
 ResolvedUmherirrenderT337130 Make PHPUnit dataProvider LexemeFieldTestBase::getTestData static (WikibaseLexemeCirrusSearch extension)
 OpenNoneT337135 Make PHPUnit dataProvider on UstringLibraryTest and LuaEngineUnitTestBase static
 ResolvedUmherirrenderT337144 Make PHPUnit dataProvider static in AbuseFilter tests
 ResolvedUmherirrenderT337155 Make PHPUnit dataProvider static in ReadingLists tests
 Resolved• mszaboT337156 Make PHPUnit dataProvider static in IPInfo tests
 ResolvedtstarlingT337157 Make PHPUnit dataProvider static in LoginNotify tests
 ResolvedUmherirrenderT337158 Make PHPUnit dataProvider static in Flow tests
 Resolved• Dreamy_JazzT337159 Make PHPUnit dataProvider static in CheckUser tests
 Resolved• Dreamy_JazzT346044 Remove CheckUserUnionQueryBuilder
 ResolvedPhysikerweltT337160 Make PHPUnit dataProvider static in Math tests
 ResolvedTgrT337161 Make PHPUnit dataProvider static in OAuth tests
 ResolvedUmherirrenderT337162 Make PHPUnit dataProvider static in ProofreadPage tests
 ResolvedUmherirrenderT337163 Make PHPUnit dataProvider static in CirrusSearch tests
 ResolvedNoneT337164 Make PHPUnit dataProvider static in FileImporter tests
 ResolvedUmherirrenderT337165 Make PHPUnit dataProvider static in GrowthExperiments tests
 ResolvedNoneT337166 Make PHPUnit dataProvider static in CampaignEvents tests
 ResolvedNoneT371467 [GENERAL] Make PHPUnit dataProvider static in Wikibase-related extensions
 ResolvedkarapayneWMDET337154 Make PHPUnit dataProvider static in Wikibase tests
 ResolvedAudreyPenven_WMDET380604 Make provideLuaData static
 ResolvedAudreyPenven_WMDET380605 Make EntityMetaTagsCreatorTestCase's provideTestGetMetaTags dataProvider static
 ResolvedLucas_Werkmeister_WMDET337153 Make PHPUnit dataProvider static in WikibaseQualityConstraints tests
 ResolvedLucas_Werkmeister_WMDET337151 Make PHPUnit dataProvider static in WikibaseLexeme tests
 ResolvedUmherirrenderT337152 Make PHPUnit dataProvider static in WikibaseMediaInfo tests
 ResolvedthiemowmdeT337150 Make PHPUnit dataProvider static in Wikidata.org tests
 ResolvedLucas_Werkmeister_WMDET337148 Make PHPUnit dataProvider static in WikibaseCirrusSearch tests
 ResolvedUmherirrenderT393065 Make PHPUnit dataProvider on ExtensionJsonTestBase static
 ResolvedUmherirrenderT393079 Make PHPUnit dataProvider static in CommunityConfiguration tests
 ResolvedUmherirrenderT393080 Make PHPUnit dataProvider static in AutoModerator tests
 ResolvedUmherirrenderT393081 Make PHPUnit dataProvider on AbstractChangesListSpecialPageTestCase static
 ResolvedUmherirrenderT393082 Make PHPUnit dataProvider on OutputTransformStageTestBase static
 ResolvedUmherirrenderT393084 Make PHPUnit dataProvider on TypeDefTestCaseTrait static
 Resolved• mszaboT393115 Make PHPUnit dataProvider on PasswordTestCase static
 ResolvedxSavitarT393122 Make PHPUnit dataProvider on BundleSizeTestBase static
 ResolvedUmherirrenderT393132 Make PHPUnit dataProvider on RevisionRecordTests static
 ResolvedUmherirrenderT393207 Make PHPUnit dataProvider on ExtensionServicesTestBase static
 ResolvedUmherirrenderT393219 Make PHPUnit dataProvider on RestStructureTest static
 OpenNoneT410731 Make production extensions PHPUnit tests data providers real providers (and use static methods)
 OpenNoneT345481 Migrate Parser and extension tests away from deprecated PHPUnit TestSuite subclassing
 OpenNoneT358394 Stop using PHPUnit's TestSuite in Scribunto
 OpenDannyS712T363064 MediaWiki.Commenting.MissingCovers.MissingCovers does not support PHPUnit 10.x attributes
 ResolvedUmherirrenderT363641 IPUtils: Expecting E_WARNING and E_USER_WARNING is deprecated and will no longer be possible in PHPUnit 10
 Resolved• larissagauliaT363650 Minify: Expecting E_WARNING and E_USER_WARNING is deprecated and will no longer be possible in PHPUnit 10
 ResolvedUmherirrenderT362858 equivset: Expecting E_ERROR and E_USER_ERROR is deprecated
 ResolvedJdforrester-WMFT395743 Use of package ockcyp/covers-validator in libaries is not compatible with PHPUnit 10
 ResolvedJdforrester-WMFT319055 Upgrade to psr/container 2.x
 ResolvedJdforrester-WMFT328921 Drop PHP 7.4 and PHP 8.0 support from MediaWiki
 ResolvedKrinkleT319432 Migrate WMF production from PHP 7.4 to PHP 8.1
 ResolvedScott_FrenchT383845 MediaWiki on PHP 8.1 production traffic ramp-up
 ResolvedScott_FrenchT377042 Support cookie-driven fractional migration to PHP 8.1 deployments of mw-web and mw-api-ext
 ResolvedScott_FrenchT377040 Turn up PHP 8.1-flavored k8s deployments for all MediaWiki services
 ResolvedKrinkleT377987 Prepare sticky cookie for gradual PHP 8.1 rollout
 ResolvedMSantosT379986 Testing and verification of MediaWiki on PHP 8.1 in mwdebug-next
 ResolvedTgrT383633 Test MediaWiki authentication on PHP 8.1 in mwdebug-next
 ResolvedScott_FrenchT372605 Extend x-wikimedia-debug-routing.lua to support PHP 8.1 mw-debug deployment
 ResolvedScott_FrenchT372604 Turn up PHP 8.1-flavored mw-debug k8s deployment
 ResolveddduvallT370934 Build and publish multiple MediaWiki production images for a given set of PHP versions
 ResolvedScott_FrenchT384532 Align mw-on-k8s alerts with PHP 8.1 migration
 ResolvedoriT385199 Gather PHP 8.1 profiling data
ResolvedClement_GoubertT387916 Migrate mw-cron to PHP 8.1
 ResolvedScott_FrenchT387917 Migrate mw-script to PHP 8.1
 In ProgressScott_FrenchT388799 php-wmerrors rsyslog rule selects on php7 only

Event Timeline

dduvall created this task.Jul 24 2024, 5:36 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 24 2024, 5:36 PM
dduvall added a parent task: T369115: [FY24-25 WE6.2.1] Publish pre-train single version containers.Jul 24 2024, 5:37 PM
• bd808 added parent tasks: T319432: Migrate WMF production from PHP 7.4 to PHP 8.1, T360995: Migrate Wikimedia production from PHP 8.1 to PHP 8.3.Jul 24 2024, 7:47 PM
• bd808 removed a parent task: T360995: Migrate Wikimedia production from PHP 8.1 to PHP 8.3.
Novem_Linguae subscribed.Jul 24 2024, 7:58 PM
Jdforrester-WMF subscribed.Jul 25 2024, 5:43 PM
Scott_French subscribed.Jul 26 2024, 8:27 PM
dancy subscribed.Aug 5 2024, 8:57 PM
Joe subscribed.Aug 6 2024, 5:37 AM

I think we need to be able to pass to the release script a set of base images for mediawiki and web, and build the final images for each of those pairs.

Right now the mediawiki-deployments.yaml file that scap reads has a series of simple dictionaries, structured as follows:

- namespace: my-mw-namespace
  release: main
  canary: canary
  mw_flavour: publish
  web_flavour: webserver
  debug: false

So in theory we already have a way to indicate the mediawiki and web flavours to build for there, we just need another configuration that tells the build process what base image corresponds to what flavour?

There's also more improvements that we'll need to make to scap, but that's probably matter of another task.

Scott_French added a comment.Aug 6 2024, 4:52 PM

Agreed with @Joe's assessment above: for each image type (e.g., mediawiki), scap would need to support a configurable set of base images from which the image will be built ("flavors").

To expand on some of the additional improvements that will be necessary to support the migration to 8.1:

  1. For a given namespace in mediawiki-deployments.yaml, scap should support additional / arbitrary helmfile releases - i.e., not just a primary release like "main" plus a canary release.
  2. In addition, scap should offer the ability to map those releases in to specific image flavors in a sensible way (again presumably in mediawiki-deployments.yaml), in turn used to render the files in /etc/helmfile-defaults/mediawiki/release/.

This would support both the 8.1 migration and any future migration that uses a similar pattern.

Stashbot added a comment.Aug 6 2024, 6:13 PM
This comment was removed by dancy.
Stashbot added a comment.Aug 6 2024, 6:44 PM
This comment was removed by dancy.
• bd808 removed a parent task: T369115: [FY24-25 WE6.2.1] Publish pre-train single version containers.Aug 8 2024, 10:55 PM
Scott_French mentioned this in T356293: Migrate MW appservers' base images to bullseye.Aug 8 2024, 11:37 PM
Scott_French mentioned this in T372604: Turn up PHP 8.1-flavored mw-debug k8s deployment.Aug 15 2024, 9:24 PM
• bd808 added a parent task: T372604: Turn up PHP 8.1-flavored mw-debug k8s deployment.Aug 15 2024, 11:44 PM
Scott_French added a comment.EditedAug 29 2024, 6:53 PM

Thanks for chatting earlier today @dduvall.

To summarize, the core requirement is that scap gains the ability to build multiple "flavors" for each image "kind" (mw, web), where flavor in this case corresponds to which base image is used, and publish that information for consumption by helmfile.

The first part is relatively straightforward - e.g., introducing a mapping (for each image kind) from flavor to base image, and parameterizing make-container-image et al. by base image / flavor.

The second part - publishing the resulting image IDs for consumption by helmfile - is a bit more open ended. What I'd propose is generalizing our deployments mapping [0] (i.e., what ends up in mediawiki-deployments.yaml) to use helmfile release as the "API" of sorts, meaning we would need to:

  1. support an arbitrary set of releases per k8s namespace, rather than a singular primary release plus one optional canary, and
  2. allow releases to be mapped to a specific flavor for to each image kind.

For example, this might end up looking like (in "maximally verbose" form - e.g., one could add a release defaults field or allow specifying certain fields at the top-level rather than per-release [1], either of which would deflate this significantly):

- namespace: mw-web
  releases:
    main:
      mw_flavour: publish-7.4
      web_flavour: webserver
    next:
      mw_flavour: publish-8.1
      web_flavour: webserver
    canary:
      stage: canaries
      mw_flavour: publish-7.4
      web_flavour: webserver
  debug: false

(Edited slightly to switch from a canary boolean to a stage association)

Then, nothing really changes about the "API" between scap and helmfile - it's all just new /etc/helmfile-defaults/mediawiki/release/ files, structured the same way as before.

This has the nice property that it retains the model we use now in our mediawiki chart, where release is ~ 1:1 with k8s deployment, which is pretty much exactly what we want for the purposes of a migration like this one. Isolating by release also allows us to easily deploy "new thing" independently and layer value overrides easily, which we'll need to do extensively in the context of the migration.

[0] https://gerrit.wikimedia.org/g/operations/puppet/+/df0ce14049768faff2c1738e7cad793fda53e71e/hieradata/role/common/deployment_server/kubernetes.yaml#261

[1] In this case, the above could collapse to:

- namespace: mw-web
  releases:
    main: {}
    next:
      mw_flavour: publish-8.1
    canary:
      stage: canaries
  mw_flavour: publish-7.4
  web_flavour: webserver
  debug: false
elukey subscribed.Sep 16 2024, 7:56 AM
MSantos subscribed.Sep 24 2024, 1:50 PM
CodeReviewBot added a project: Patch-For-Review.Sep 27 2024, 6:55 PM

swfrench opened https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/462

kubernetes: generalize deployments configuration

CodeReviewBot added a comment.Oct 2 2024, 2:59 PM

dancy merged https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/462

kubernetes: generalize deployments configuration

dancy mentioned this in rMSCAe85156caab72: kubernetes: generalize deployments configuration.Oct 2 2024, 2:59 PM
Stashbot added a comment.Oct 2 2024, 3:22 PM

Mentioned in SAL (#wikimedia-operations) [2024-10-02T15:22:44Z] <dancy@deploy2002> Started scap sync-world: Testing T370934

Stashbot added a comment.Oct 2 2024, 3:26 PM

Mentioned in SAL (#wikimedia-operations) [2024-10-02T15:26:04Z] <dancy@deploy2002> Finished scap sync-world: Testing T370934 (duration: 03m 19s)

Maintenance_bot removed a project: Patch-For-Review.Oct 2 2024, 3:30 PM
gerritbot added a comment.Oct 3 2024, 3:14 PM

Change #1077479 had a related patch set uploaded (by Scott French; author: Scott French):

[operations/puppet@production] types: extend Profile::Mediawiki_deployment

https://gerrit.wikimedia.org/r/1077479

gerritbot added a project: Patch-For-Review.Oct 3 2024, 3:14 PM

Change #1077480 had a related patch set uploaded (by Scott French; author: Scott French):

[operations/puppet@production] hieradata: use 'releases' in mw-debug mw_releases

https://gerrit.wikimedia.org/r/1077480

gerritbot added a comment.Oct 3 2024, 3:14 PM

Change #1077482 had a related patch set uploaded (by Scott French; author: Scott French):

[operations/puppet@production] hieradata: convert remaining mw_releases entries

https://gerrit.wikimedia.org/r/1077482

gerritbot added a comment.Oct 3 2024, 3:14 PM

Change #1077483 had a related patch set uploaded (by Scott French; author: Scott French):

[operations/puppet@production] types: remove older Mediawiki_deployment variant

https://gerrit.wikimedia.org/r/1077483

gerritbot added a comment.Oct 3 2024, 4:24 PM

Change #1077479 merged by Scott French:

[operations/puppet@production] types: extend Profile::Mediawiki_deployment

https://gerrit.wikimedia.org/r/1077479

gerritbot added a comment.Oct 3 2024, 5:02 PM

Change #1077480 merged by Scott French:

[operations/puppet@production] hieradata: use 'releases' in mw-debug mw_releases

https://gerrit.wikimedia.org/r/1077480

Stashbot added a comment.Oct 3 2024, 5:11 PM

Mentioned in SAL (#wikimedia-operations) [2024-10-03T17:11:07Z] <swfrench@deploy2002> Started scap sync-world: Testing after mediawiki-deployments.yaml format change - T370934

Stashbot added a comment.Oct 3 2024, 5:13 PM

Mentioned in SAL (#wikimedia-operations) [2024-10-03T17:13:57Z] <swfrench@deploy2002> Finished scap sync-world: Testing after mediawiki-deployments.yaml format change - T370934 (duration: 02m 50s)

Scott_French added a comment.Oct 3 2024, 5:35 PM

Test deployment looks good. I'll wait at least a day (so, effectively, until Monday) to make any changes that critically depend on the new format, in case any surprise consumers of mediawiki-deployments.yaml are broken and need fixed.

Scott_French added a parent task: T377040: Turn up PHP 8.1-flavored k8s deployments for all MediaWiki services.Oct 11 2024, 7:37 PM
• bd808 subscribed.Oct 15 2024, 4:03 PM
gerritbot added a comment.Oct 15 2024, 5:01 PM

Change #1077482 merged by Scott French:

[operations/puppet@production] hieradata: convert remaining mw_releases entries

https://gerrit.wikimedia.org/r/1077482

Stashbot added a comment.Oct 15 2024, 5:10 PM

Mentioned in SAL (#wikimedia-operations) [2024-10-15T17:10:39Z] <swfrench@deploy2002> Started scap sync-world: Testing scap after mediawiki-deployments.yaml format change - T370934

Stashbot added a comment.Oct 15 2024, 5:13 PM

Mentioned in SAL (#wikimedia-operations) [2024-10-15T17:13:27Z] <swfrench@deploy2002> Finished scap sync-world: Testing scap after mediawiki-deployments.yaml format change - T370934 (duration: 02m 47s)

Scott_French added a comment.Oct 15 2024, 5:17 PM

No issues encountered during testing after updating the remaining entries to the new release format. I'll follow up with a patch for train-dev shortly.

CodeReviewBot added a comment.Oct 15 2024, 6:38 PM

swfrench opened https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/95

Update mediawiki-deployments.yaml to new format

CodeReviewBot added a comment.Oct 15 2024, 8:35 PM

dancy merged https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/95

Update mediawiki-deployments.yaml to new format

gerritbot added a comment.Oct 15 2024, 9:04 PM

Change #1077483 merged by Scott French:

[operations/puppet@production] types: remove older Mediawiki_deployment variant

https://gerrit.wikimedia.org/r/1077483

Maintenance_bot removed a project: Patch-For-Review.Oct 15 2024, 9:30 PM
akosiaris subscribed.Oct 16 2024, 3:16 PM
Scott_French updated the task description. (Show Details)Oct 16 2024, 3:52 PM
CDanis subscribed.Oct 16 2024, 4:08 PM
CodeReviewBot added a project: Patch-For-Review.Oct 16 2024, 9:39 PM

swfrench opened https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/484

kubernetes: drop older DeploymentsConfig support

CodeReviewBot added a comment.Oct 17 2024, 6:57 PM

dancy merged https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/484

kubernetes: drop older DeploymentsConfig support

dancy mentioned this in rMSCA391609c1ea87: kubernetes: drop older DeploymentsConfig support.Oct 17 2024, 6:58 PM
Maintenance_bot removed a project: Patch-For-Review.Oct 17 2024, 7:30 PM
CodeReviewBot added a project: Patch-For-Review.Oct 29 2024, 5:53 PM

dduvall opened https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/129

build-images.py: Build multiple PHP flavours of each image

CodeReviewBot added a comment.Oct 29 2024, 10:41 PM

dduvall opened https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/520

kubernetes: Support deployment of image flavours

dancy moved this task from Priority Backlog 📥 to Doing 😎 on the Release-Engineering-Team board.Oct 30 2024, 4:55 PM
dancy edited projects, added Release-Engineering-Team (Doing 😎); removed Release-Engineering-Team (Priority Backlog 📥).
CodeReviewBot added a comment.Oct 31 2024, 7:02 PM

dduvall opened https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/133

build-images.py: Build multiple flavours of each image

CodeReviewBot added a comment.Oct 31 2024, 7:02 PM

dduvall opened https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/135

make-container-image: Parallelize image builds

CodeReviewBot added a comment.Oct 31 2024, 7:03 PM

dduvall closed https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/133

build-images.py: Build multiple flavours of each image

CodeReviewBot added a comment.Oct 31 2024, 7:03 PM

dduvall closed https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/135

make-container-image: Parallelize image builds

CodeReviewBot added a comment.Nov 5 2024, 6:00 PM

dduvall merged https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/129

build-images.py: Build multiple flavours of each image

CodeReviewBot added a comment.Nov 5 2024, 6:04 PM

dduvall merged https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/131

make-container-image: Parallelize image builds

Novem_Linguae unsubscribed.Nov 5 2024, 6:07 PM
Scott_French mentioned this in T372603: Regenerate UcfirstOverrides.php for PHP 7.4 -> 8.1 transition.Nov 5 2024, 9:59 PM
CodeReviewBot added a comment.Nov 6 2024, 5:56 PM

dduvall merged https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/520

kubernetes: Support deployment of image flavours

thcipriani subscribed.Nov 19 2024, 3:14 PM

I see 8.1 images getting published by our deploys: https://docker-registry.wikimedia.org/restricted/mediawiki-multiversion/tags/

Anything left for this task or is it fine to close out?

Scott_French added a comment.Nov 19 2024, 3:49 PM

No objections from my end - this all seems to be working nicely. Thanks, @dduvall!

dduvall closed this task as Resolved.Nov 19 2024, 7:03 PM
In T370934#10336393, @Scott_French wrote:

No objections from my end - this all seems to be working nicely. Thanks, @dduvall!

Of course!

thcipriani awarded a token.Nov 19 2024, 9:17 PM
Scott_French updated the task description. (Show Details)Jan 16 2025, 5:24 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits