Page MenuHomePhabricator
Create Task
Maniphest T252432

Drop MediaWiki testing in stretch and instead test only in buster
Closed, ResolvedPublic
Actions

Description

  • T252434: Test MW code in buster as well as stretch
  • Drop PHP 7.2-on-stretch jobs from Zuul configuration
  • Provide buster variants of all other flavours of PHP (80, 74, 73, ¿71?, ¿70?)
  • Enable PHP *-on-buster jobs as experimental
  • Ensure everything passes
  • Drop stretch jobs use from Zuul configuration
  • Drop stretch jobs from jjb configuration and delete
  • Drop stretch docker images for quibble

Details

SubjectRepoBranchLines +/-
Docker: Drop quibble-stretch-php72 and quibble-stretch, no longer usedintegration/configmaster+1 -1 K
dockerfiles: Drop quibble-stretch-bundle, unusedintegration/configmaster+0 -523
dockerfiles: Drop quibble-stretch-php72-apache, unusedintegration/configmaster+0 -225
jjb: [integration-quibble-apache-fullrun] Switch to busterintegration/configmaster+1 -1
dockerfiles: Drop quibble-stretch-php{73,74,80}, no longer usedintegration/configmaster+0 -684
dockerfiles: Provide quibble-buster-php72-bundleintegration/configmaster+99 -0
jjb: [quibble*] Switch PHP73/74/80 jobs to buster imagesintegration/configmaster+3 -3
jjb: Update fundraising quibble jobs to busterintegration/configmaster+2 -2
jjb: Switch Wikibase custom jobs to busterintegration/configmaster+1 -1
jjb: Switch quibble apache jobs to busterintegration/configmaster+2 -2
jjb: Switch all phan uses of quibble-stretch-php72 image to busterintegration/configmaster+1 -1
jjb: [integration-quibble-fullrun] Switch to busterintegration/configmaster+1 -1
jjb: [parsoidsvc-parsertests-docker] Switch to busterintegration/configmaster+1 -1
jjb: Switch mediawiki-quibble-selenium* to busterintegration/configmaster+1 -1
jjb: Switch mediawiki-quibble-api-testing* to busterintegration/configmaster+1 -1
jjb: Drop all quibble 'php72_buster' jobs, no longer usedintegration/configmaster+0 -2
Zuul: Drop the now duplicate PHP72 'buster' quibble jobsintegration/configmaster+0 -16
jjb: Switch wmf-quibble php72 jobs over to busterintegration/configmaster+1 -1
jjb: Switch all quibble php72 jobs over to busterintegration/configmaster+1 -1
dockerfiles: Provide quibble-buster-php*integration/configmaster+397 -0
Show related patches Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedhasharT278203 Migrate all CI jobs from stretch to buster or later and drop stretch testing support
 ResolvedJdforrester-WMFT252432 Drop MediaWiki testing in stretch and instead test only in buster
 ResolvedDzahnT245757 Upgrade MediaWiki clusters to Debian Buster (debian 10)
 ResolvedhasharT252434 Test MW code in buster as well as stretch
 ResolvedJdforrester-WMFT250514 Create buster-based images for quibble
 ResolvedLadsgroupT279068 Wikibase data-client bridge selenium failure on buster but not stretch
 ResolvedMoritzMuehlenhoffT250515 Please provide our special component/php72 in buster-wikimedia
 ResolvedjijikiT264991 Upgrade the MediaWiki servers to ICU 63
 ResolvedMoritzMuehlenhoffT253377 WMF deployed EasyTimeline extension depends on Ploticus package which is not available in Debian Buster (but available again in Debian Bullseye)
 ResolvedTrizek-WMFT267145 CommRel support for ICU 63 upgrade
 ResolvedDzahnT267248 create mwdebug1003 - ganeti VM with buster and appserver role
 Resolved• GillesT268188 Release WikimediaDebug for mwdebug1003 addition
 ResolvedDzahnT267607 upgrade mwmaint servers to buster
ResolvedRequestPapaulT275928 decommission mwmaint2001.codfw.wmnet
 ResolvedjijikiT268524 Upgrade Parsoid servers to buster
DeclinedNoneT245888 Rename wtp* servers to parse* (Parsoid PHP servers)
 ResolvedDzahnT268248 upgrade scandium to buster
 ResolvedDzahnT265963 Replace production deployment servers and update them to Buster
Unknown Object (Task)
 ResolvedPapaulT266363 (Need By: TBD) rack/setup/install deploy2002
 Resolved• CmjohnsonT265653 (Need By: TBD) setup/install deploy1002
 ResolvedRequest• CmjohnsonT275831 decommission deploy1001.eqiad.wmnet
 ResolvedRequestPapaulT275832 decommission deploy2001.codfw.wmnet
 ResolvedAndrewT269004 Upgrade labweb servers to buster
 ResolvedArielGlennT269377 Upgrade snapshot hosts to Buster
 ResolvedDzahnT270517 Investigate opcache hit rate on Buster appserver
 ResolvedLegoktmT273312 Investigate possible performance degradation on mediawiki servers after Debian Buster upgrade
 ResolvedPapaulT273803 mw2220 - broken IPMI / mgmt
ResolvedDzahnT274023 Convert mwdebug VMs to debian buster
 Declined• GillesT274026 Add 3 new canaries to WikimediaDebug
 ResolvedVolansT274689 sre.hosts.decomission -> generate_dns_snippets - > Cumin execution failed
 ResolvedDzahnT274403 mw1379 - down after reboot attempt and DRAC can't powercycle
 ResolvedLegoktmT275752 Jobrunner timeouts on cross-DC file uploads because of HTTP/2

Event Timeline

Jdforrester-WMF created this task.May 11 2020, 5:51 PM
Jdforrester-WMF mentioned this in T248191: Can't reopen table in wikidb-unittest_ (from SpecialPageFatalTest).
Jdforrester-WMF added a parent task: T248191: Can't reopen table in wikidb-unittest_ (from SpecialPageFatalTest).
Jdforrester-WMF added subtasks: T250514: Create buster-based images for quibble, T250666: Upgrade WMF database-and-backup-related hosts to buster, T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).
Jdforrester-WMF removed a subtask: T250514: Create buster-based images for quibble.May 11 2020, 5:56 PM
hashar removed a project: Quibble.May 19 2020, 1:05 PM
Jdforrester-WMF moved this task from Untriaged to Backlog on the Continuous-Integration-Infrastructure board.Jun 11 2020, 5:03 PM
Tgr mentioned this in T256822: [EPIC] Upgrade MediaWiki-Vagrant to Debian Buster.Jun 30 2020, 10:11 PM
greg added a project: Release-Engineering-Team-TODO.Aug 18 2020, 5:06 AM
greg moved this task from Should be empty (use Release-Engineering-Team) to Blocked externally on the Release-Engineering-Team-TODO board.
jijiki changed the status of subtask T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10) from Stalled to Open.Oct 28 2020, 3:39 PM
Legoktm changed the status of subtask T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10) from Open to Stalled.Jan 30 2021, 9:11 AM
Legoktm changed the status of subtask T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10) from Stalled to Open.Feb 4 2021, 12:10 AM
Dzahn subscribed.Feb 6 2021, 1:24 AM

T274023 - create mwdebug1004, mwdebug2003 and mwdebug2004 as mediawiki::canary_appserver

Dzahn added a subtask: T274023: Convert mwdebug VMs to debian buster.Feb 6 2021, 1:24 AM
Dzahn closed subtask T274023: Convert mwdebug VMs to debian buster as Resolved.Feb 17 2021, 1:45 AM
Jdforrester-WMF mentioned this in T278203: Migrate all CI jobs from stretch to buster or later and drop stretch testing support.Mar 23 2021, 1:49 AM
Jdforrester-WMF added a parent task: T278203: Migrate all CI jobs from stretch to buster or later and drop stretch testing support.
Jdforrester-WMF updated the task description. (Show Details)
gerritbot added a comment.Mar 23 2021, 1:57 AM

Change 674175 had a related patch set uploaded (by Jforrester; owner: Jforrester):
[integration/config@master] jjb: Switch all quibble php72 jobs over to buster

https://gerrit.wikimedia.org/r/674175

gerritbot added a project: Patch-For-Review.Mar 23 2021, 1:57 AM

Change 674176 had a related patch set uploaded (by Jforrester; owner: Jforrester):
[integration/config@master] Zuul: Drop the now duplicate PHP72 'buster' quibble jobs

https://gerrit.wikimedia.org/r/674176

gerritbot added a comment.Mar 23 2021, 5:10 AM

Change 674177 had a related patch set uploaded (by Jforrester; owner: Jforrester):
[integration/config@master] jjb: Drop all quibble php72 jobs on buster

https://gerrit.wikimedia.org/r/674177

gerritbot added a comment.Mar 23 2021, 5:11 AM

Change 674178 had a related patch set uploaded (by Jforrester; owner: Jforrester):
[integration/config@master] jjb: Switch all remaining uses of quibble-stretch-php72 image to buster

https://gerrit.wikimedia.org/r/674178

gerritbot added a comment.Mar 23 2021, 5:11 AM

Change 674179 had a related patch set uploaded (by Jforrester; owner: Jforrester):
[integration/config@master] dockerfiles: Provide quibble-buster-php*

https://gerrit.wikimedia.org/r/674179

gerritbot added a comment.Mar 23 2021, 5:11 AM

Change 674180 had a related patch set uploaded (by Jforrester; owner: Jforrester):
[integration/config@master] jjb: [quibble] Switch PHP73/74/80 jobs to buster images

https://gerrit.wikimedia.org/r/674180

gerritbot added a comment.Mar 23 2021, 5:11 AM

Change 674181 had a related patch set uploaded (by Jforrester; owner: Jforrester):
[integration/config@master] dockerfiles: Drop quibble-stretch-php72+, unused

https://gerrit.wikimedia.org/r/674181

gerritbot added a comment.Mar 23 2021, 5:27 AM

Change 674192 had a related patch set uploaded (by Jforrester; owner: Jforrester):
[integration/config@master] dockerfiles: Provide quibble-buster-php72-bundle

https://gerrit.wikimedia.org/r/674192

gerritbot added a comment.Mar 23 2021, 5:28 AM

Change 674193 had a related patch set uploaded (by Jforrester; owner: Jforrester):
[integration/config@master] jjb: Switch quibble 'bundle' jobs to buster

https://gerrit.wikimedia.org/r/674193

gerritbot added a comment.Apr 10 2021, 11:54 PM

Change 674179 merged by jenkins-bot:

[integration/config@master] dockerfiles: Provide quibble-buster-php*

https://gerrit.wikimedia.org/r/674179

Stashbot added a comment.Apr 11 2021, 12:02 AM

Mentioned in SAL (#wikimedia-releng) [2021-04-11T00:02:52Z] <James_F> Docker: Publishing quibble-buster images T252432

Daimona subscribed.Apr 16 2021, 4:02 PM
Jdforrester-WMF updated the task description. (Show Details)Apr 16 2021, 7:22 PM
gerritbot added a comment.Apr 16 2021, 7:32 PM

Change 674175 merged by jenkins-bot:

[integration/config@master] jjb: Switch all quibble php72 jobs over to buster

https://gerrit.wikimedia.org/r/674175

gerritbot added a comment.Apr 16 2021, 7:34 PM

Change 680411 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] jjb: Switch wmf-quibble php72 jobs over to buster

https://gerrit.wikimedia.org/r/680411

gerritbot added a comment.Apr 16 2021, 7:35 PM

Change 680411 merged by jenkins-bot:

[integration/config@master] jjb: Switch wmf-quibble php72 jobs over to buster

https://gerrit.wikimedia.org/r/680411

gerritbot added a comment.Apr 16 2021, 7:43 PM

Change 674176 merged by jenkins-bot:

[integration/config@master] Zuul: Drop the now duplicate PHP72 'buster' quibble jobs

https://gerrit.wikimedia.org/r/674176

Stashbot added a comment.Apr 16 2021, 7:43 PM

Mentioned in SAL (#wikimedia-releng) [2021-04-16T19:43:48Z] <James_F> Zuul: Drop the now duplicate PHP72 'buster' quibble jobs T252432

gerritbot added a comment.Apr 16 2021, 7:50 PM

Change 674177 merged by jenkins-bot:

[integration/config@master] jjb: Drop all quibble 'php72_buster' jobs, no longer used

https://gerrit.wikimedia.org/r/674177

Jdforrester-WMF updated the task description. (Show Details)Apr 16 2021, 7:54 PM
gerritbot added a comment.Apr 16 2021, 8:15 PM

Change 680419 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] jjb: Switch mediawiki-quibble-api-testing* to buster

https://gerrit.wikimedia.org/r/680419

gerritbot added a comment.Apr 16 2021, 8:15 PM

Change 680420 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] jjb: Switch mediawiki-quibble-selenium* to buster

https://gerrit.wikimedia.org/r/680420

gerritbot added a comment.Apr 16 2021, 8:15 PM

Change 680421 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] jjb: [parsoidsvc-parsertests-docker] Switch to buster

https://gerrit.wikimedia.org/r/680421

gerritbot added a comment.Apr 16 2021, 8:15 PM

Change 680424 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] jjb: Switch quibble apache jobs to buster

https://gerrit.wikimedia.org/r/680424

gerritbot added a comment.Apr 16 2021, 9:23 PM

Change 680419 merged by jenkins-bot:

[integration/config@master] jjb: Switch mediawiki-quibble-api-testing* to buster

https://gerrit.wikimedia.org/r/680419

gerritbot added a comment.Apr 16 2021, 9:27 PM

Change 680420 merged by jenkins-bot:

[integration/config@master] jjb: Switch mediawiki-quibble-selenium* to buster

https://gerrit.wikimedia.org/r/680420

gerritbot added a comment.Apr 16 2021, 9:28 PM

Change 680422 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] jjb: [integration-quibble-fullrun] Switch to buster

https://gerrit.wikimedia.org/r/680422

gerritbot added a comment.Apr 16 2021, 9:28 PM

Change 680421 merged by jenkins-bot:

[integration/config@master] jjb: [parsoidsvc-parsertests-docker] Switch to buster

https://gerrit.wikimedia.org/r/680421

gerritbot added a comment.Apr 16 2021, 9:30 PM

Change 680422 merged by jenkins-bot:

[integration/config@master] jjb: [integration-quibble-fullrun] Switch to buster

https://gerrit.wikimedia.org/r/680422

gerritbot added a comment.Apr 16 2021, 9:32 PM

Change 680423 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] jjb: [integration-quibble-apache-fullrun] Switch to buster

https://gerrit.wikimedia.org/r/680423

gerritbot added a comment.Apr 16 2021, 9:33 PM

Change 674178 merged by jenkins-bot:

[integration/config@master] jjb: Switch all phan uses of quibble-stretch-php72 image to buster

https://gerrit.wikimedia.org/r/674178

gerritbot added a comment.Apr 16 2021, 9:54 PM

Change 680424 merged by jenkins-bot:

[integration/config@master] jjb: Switch quibble apache jobs to buster

https://gerrit.wikimedia.org/r/680424

gerritbot added a comment.Apr 16 2021, 10:09 PM

Change 680456 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] jjb: Switch Wikibase custom jobs to buster

https://gerrit.wikimedia.org/r/680456

gerritbot added a comment.Apr 16 2021, 10:09 PM

Change 680457 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] jjb: Update fundraising quibble jobs to buster

https://gerrit.wikimedia.org/r/680457

gerritbot added a comment.Apr 16 2021, 10:14 PM

Change 680456 merged by jenkins-bot:

[integration/config@master] jjb: Switch Wikibase custom jobs to buster

https://gerrit.wikimedia.org/r/680456

gerritbot added a comment.Apr 16 2021, 10:24 PM

Change 680457 merged by jenkins-bot:

[integration/config@master] jjb: Update fundraising quibble jobs to buster

https://gerrit.wikimedia.org/r/680457

gerritbot added a comment.Apr 16 2021, 10:36 PM

Change 674180 merged by jenkins-bot:

[integration/config@master] jjb: [quibble*] Switch PHP73/74/80 jobs to buster images

https://gerrit.wikimedia.org/r/674180

gerritbot added a comment.Apr 16 2021, 10:36 PM

Change 674192 merged by jenkins-bot:

[integration/config@master] dockerfiles: Provide quibble-buster-php72-bundle

https://gerrit.wikimedia.org/r/674192

Jdforrester-WMF closed this task as Resolved.Apr 16 2021, 10:38 PM
Jdforrester-WMF claimed this task.
Jdforrester-WMF updated the task description. (Show Details)
gerritbot added a comment.Apr 16 2021, 10:59 PM

Change 680468 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] dockerfiles: Drop quibble-stretch-php{73,74,80}, no longer used

https://gerrit.wikimedia.org/r/680468

gerritbot added a comment.Apr 16 2021, 11:06 PM

Change 680468 merged by jenkins-bot:

[integration/config@master] dockerfiles: Drop quibble-stretch-php{73,74,80}, no longer used

https://gerrit.wikimedia.org/r/680468

Dzahn awarded a token.Apr 19 2021, 7:16 PM

Thanks!

fyi: mwdebug1003 (stretch debug server) removed Friday/today. and remaining 3 stretch servers reimaged with buster as well now.

Jdforrester-WMF removed a subtask: T250666: Upgrade WMF database-and-backup-related hosts to buster.Apr 21 2021, 10:59 PM
Krinkle awarded a token.Apr 21 2021, 11:01 PM
gerritbot added a comment.Apr 30 2021, 3:46 AM

Change 680423 merged by jenkins-bot:

[integration/config@master] jjb: [integration-quibble-apache-fullrun] Switch to buster

https://gerrit.wikimedia.org/r/680423

gerritbot added a comment.Apr 30 2021, 3:47 AM

Change 683778 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] dockerfiles: Drop quibble-stretch-php72-apache, unused

https://gerrit.wikimedia.org/r/683778

gerritbot added a comment.Apr 30 2021, 3:49 AM

Change 683778 merged by jenkins-bot:

[integration/config@master] dockerfiles: Drop quibble-stretch-php72-apache, unused

https://gerrit.wikimedia.org/r/683778

Izno removed a parent task: T248191: Can't reopen table in wikidb-unittest_ (from SpecialPageFatalTest).Jun 1 2021, 11:15 PM
Izno removed a parent task: T278203: Migrate all CI jobs from stretch to buster or later and drop stretch testing support.
Izno removed a subtask: T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).Jun 1 2021, 11:17 PM
Jdforrester-WMF added a parent task: T278203: Migrate all CI jobs from stretch to buster or later and drop stretch testing support.Jun 3 2021, 12:11 AM
Jdforrester-WMF added a subtask: T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10).
Jdforrester-WMF added a subscriber: Izno.

@Izno: Not sure what you're doing? Please don't remove blockers like this, especially without any comment justifying the change.

Izno added a comment.EditedJun 3 2021, 4:22 AM
In T252432#7130889, @Jdforrester-WMF wrote:

@Izno: Not sure what you're doing? Please don't remove blockers like this, especially without any comment justifying the change.

I routinely remove links from parent to child when the parent is closed but the child is not, under BOLDish lines. When such occurs, it usually indicates that the task chains are wrong in some way (i.e. this task does *not* actually depend on its children) and often loses visibility into open child tasks still blocking some grandparent task. When I do so, I connect any remaining open tasks in the chain to their supposed parents and children.

As it's a gnomish activity and on the balance it takes a bit of time when I find a thicket, and we don't have edit summaries here beyond a comment which seems like overkill, I haven't been leaving comments.

You're free to correct or revert of course.

Jdforrester-WMF added a comment.Jun 3 2021, 3:46 PM
In T252432#7131056, @Izno wrote:
In T252432#7130889, @Jdforrester-WMF wrote:

@Izno: Not sure what you're doing? Please don't remove blockers like this, especially without any comment justifying the change.

I routinely remove links from parent to child when the parent is closed but the child is not, under BOLDish lines. When such occurs, it usually indicates that the task chains are wrong in some way (i.e. this task does *not* actually depend on its children) and often loses visibility into open child tasks still blocking some grandparent task. When I do so, I connect any remaining open tasks in the chain to their supposed parents and children.

As it's a gnomish activity and on the balance it takes a bit of time when I find a thicket, and we don't have edit summaries here beyond a comment which seems like overkill, I haven't been leaving comments.

Please, stop. This almost always means that someone should re-consider this properly. If you don't have enough time to leave a comment, you shouldn't do anything. You should leave a comment asking for involved people to work out whether things need fixing in the way you suggest, or something else.

In this particular case, this was intentional to flag that we'd dropped the testing ahead of the final bits of production roll-over, which was an unusual situation that needed flagging.

You're free to correct or revert of course.

Yes, I can, but remembering every few weeks to run a query digging up from the DB a list of all your edits and reverting them would be exceedingly tedious.

BOLD does not apply here. This is not the English Wikipedia. This is not just helpfully fixing a typo.

gerritbot added a comment.Jun 12 2021, 7:47 PM

Change 674181 merged by jenkins-bot:

[integration/config@master] dockerfiles: Drop quibble-stretch-bundle, unused

https://gerrit.wikimedia.org/r/674181

Dzahn changed the status of subtask T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10) from Open to Stalled.Aug 5 2021, 1:37 PM
gerritbot added a comment.Aug 30 2021, 4:42 PM

Change 715539 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] Docker: Drop quibble-stretch-php72 and quibble-stretch, no longer used

https://gerrit.wikimedia.org/r/715539

gerritbot added a comment.Aug 30 2021, 4:43 PM

Change 715539 merged by jenkins-bot:

[integration/config@master] Docker: Drop quibble-stretch-php72 and quibble-stretch, no longer used

https://gerrit.wikimedia.org/r/715539

Dzahn changed the status of subtask T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10) from Stalled to In Progress.Sep 16 2021, 2:38 PM
Dzahn closed subtask T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10) as Resolved.Sep 16 2021, 3:22 PM
fgiunchedi reopened subtask T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10) as Open.Sep 24 2021, 8:33 AM
Legoktm closed subtask T245757: Upgrade MediaWiki clusters to Debian Buster (debian 10) as Resolved.Nov 4 2021, 7:10 PM
Jdforrester-WMF mentioned this in T335766: Migrate Quibble images from buster to bullseye.Apr 16 2024, 6:05 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL