Page MenuHomePhabricator
Create Task
Maniphest T306068

Cloud VPS "deployment-prep" project Stretch deprecation
Closed, ResolvedPublic
Actions

Description

The end of life of Debian Stretch is approaching in 2022 and we need to move to Debian Bullseye (or Buster) before that date.

All instances in the deployment-prep project need to upgrade as soon as possible. Instances not upgraded by 2022-05-01 may be subject to deletion unless prior arrangements for an extended deadline has been approved by the Cloud VPS administration team.

Remaining Debian Stretch instances (live report):

Listed administrators are:

See also:

More info on current project instances is available via openstack browser.

Details

Due Date
Apr 30 2022, 11:59 PM
SubjectRepoBranchLines +/-
restbase-beta: Change wikifeeds URI for deployment prepoperations/puppetproduction+1 -1
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedNoneT306068 Cloud VPS "deployment-prep" project Stretch deprecation
 ResolvedtaaviT278641 Migrate deployment-prep away from Debian Stretch to Buster/Bullseye
 ResolvedtaaviT278664 Upgrade deployment-prep MediaWiki clusters to Buster
 ResolvedtaaviT278677 curl on deployment-prep Buster hosts does not trust Puppet CA
 ResolvedtaaviT278689 Upgrade deployment-prep deploy* hosts to Buster
 Resolved• BstormT277078 Support Cinder for CI docker workers
 OpenNoneT294148 Replace deployment-imagescaler03 (stretch) with deployment-imagescaler04 (buster)
 ResolvedLegoktmT294393 Build and publish python-logstash deb for Buster
 DuplicateNoneT298253 Upgrade deployment-prep Swift cluster to Debian Buster or newer
 ResolvedAndrewT301637 Upgrade deployment-mdb01 to Buster/Bullseye
 Resolved• dpifkeT301638 Upgrade deployment-webperf hosts to Debian Buster or Bullseye
 ResolvedTheresNoTimeT301819 Upgrade deployment-prep Kafka clusters to Debian Buster or later
 ResolvedbkingT299797 Deploy new bullseye elastic cluster nodes on deployment-prep
 ResolvedbkingT301408 Enable search team SRE access to deployment-prep VMs
 ResolvedbkingT307510 Update tls proxy config for Bullseye
 ResolvedAndrewT306049 Upgrade deployment-docker-citoid01 host to Buster
 ResolvedAndrewT306050 Upgrade deployment-docker-cxserver01 host to Buster
 ResolvedAndrewT306051 Upgrade deployment-docker-mathoid01 host to Buster
 ResolvedNoneT306052 Upgrade deployment-restbase03 host to Buster
 ResolvedelukeyT306053 Upgrade deployment-ores01 host to Buster
 ResolvedbkingT306054 Upgrade deployment-wdqs01 host to Buster
 ResolvedAndrewT306055 Upgrade deployment-wikifeeds01 host to Buster
 ResolvedOttomataT304433 Upgrade event platform related VMs in deployment-prep to Debian bullsye (or buster)
 ResolvedVgutierrezT322231 Create new deployment-ms-be instances running Debian Bullseye
 ResolvedVgutierrezT322554 Create new deployment-ms-fe instance running Debian Bullseye

Event Timeline

StrikerBot triaged this task as Medium priority.Apr 13 2022, 4:59 PM
StrikerBot created this task.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 13 2022, 4:59 PM
Ottomata updated the task description. (Show Details)Apr 13 2022, 5:03 PM

I'm working on eventgate and kafka nodes and others in T304433: Upgrade event platform related VMs in deployment-prep to Debian bullsye (or buster). Updated description with link to subtask.

Ottomata added a subtask: T304433: Upgrade event platform related VMs in deployment-prep to Debian bullsye (or buster).Apr 13 2022, 5:04 PM
taavi added a subtask: T278641: Migrate deployment-prep away from Debian Stretch to Buster/Bullseye.Apr 13 2022, 5:04 PM
taavi added a project: Beta-Cluster-Infrastructure.
Zabe changed the edit policy from "Custom Policy" to "All Users".Apr 13 2022, 5:35 PM
Lucas_Werkmeister_WMDE updated the task description. (Show Details)Apr 14 2022, 7:58 AM
Lucas_Werkmeister_WMDE added a subtask: T306054: Upgrade deployment-wdqs01 host to Buster.
Jdforrester-WMF added a comment.Apr 14 2022, 8:09 AM

Duplicate of T278641: Migrate deployment-prep away from Debian Stretch to Buster/Bullseye; would it be unhelpful to merge this task into that, if @StrikerBot is looking for this particular one or something?

hashar unsubscribed.Apr 19 2022, 9:36 AM
Ottomata updated the task description. (Show Details)Apr 25 2022, 7:17 PM
Ottomata updated the task description. (Show Details)
Ottomata added a subscriber: hashar.
Krinkle updated the task description. (Show Details)Apr 25 2022, 7:23 PM
Krinkle unsubscribed.
Jdforrester-WMF closed subtask T306054: Upgrade deployment-wdqs01 host to Buster as Resolved.Apr 25 2022, 8:49 PM
hashar updated the task description. (Show Details)Apr 26 2022, 7:42 AM
hashar unsubscribed.
Stashbot added a comment.Apr 26 2022, 1:46 PM

Mentioned in SAL (#wikimedia-releng) [2022-04-26T13:46:25Z] <James_F> Deleting deployment-mx02.deployment-prep.eqiad1.wikimedia.cloud for T306068

Jdforrester-WMF updated the task description. (Show Details)Apr 26 2022, 1:46 PM
bking subscribed.Apr 26 2022, 3:48 PM
Ottomata closed subtask T304433: Upgrade event platform related VMs in deployment-prep to Debian bullsye (or buster) as Resolved.Jun 15 2022, 1:28 PM
TheresNoTime moved this task from To Triage to Epics / Tracking on the Beta-Cluster-Infrastructure board.Aug 17 2022, 3:00 PM
Krinkle mentioned this in T313195: Cloud VPS Project Stretch Deprecation - Exemptions.Oct 13 2022, 8:43 PM
Andrew updated the task description. (Show Details)Oct 31 2022, 3:53 PM
Andrew updated the task description. (Show Details)
Stashbot added a comment.Oct 31 2022, 3:56 PM

Mentioned in SAL (#wikimedia-cloud) [2022-10-31T15:56:33Z] <andrewbogott> shutting down deployment-echostore01, deployment-ms-be0[56], deployment-mdb01, deployment-prometheus02, deployment-wikifeeds01 as per https://phabricator.wikimedia.org/T306068

MoritzMuehlenhoff subscribed.Nov 1 2022, 10:52 AM

deployment-ms-fe03.deployment-prep.eqiad1.wikimedia.cloud can also be shutdown/replaced with a bullseye instance, the Swift frontends in production are on Bullseye (there's a Stretch instance left in each DC for swift mirroring,but that is irrelevant for deployment-prep)-

Vgutierrez updated the task description. (Show Details)Nov 2 2022, 4:27 PM
Vgutierrez updated the task description. (Show Details)Nov 7 2022, 4:36 PM
Vgutierrez updated the task description. (Show Details)
Vgutierrez updated the task description. (Show Details)Nov 8 2022, 6:12 AM
Vgutierrez updated the task description. (Show Details)Nov 8 2022, 3:28 PM
Jgiannelos added a comment.EditedNov 28 2022, 5:09 PM

I prepared a new instance called deployment-wikifeeds02 for wikifeeds thats based on bullseye and updated the webproxy to point to the right instance.

Jgiannelos updated the task description. (Show Details)Nov 28 2022, 5:09 PM
gerritbot added a comment.Nov 29 2022, 10:42 AM

Change 861821 had a related patch set uploaded (by Jgiannelos; author: Jgiannelos):

[operations/puppet@production] restbase-beta: Change wikifeeds URI for deployment prep

https://gerrit.wikimedia.org/r/861821

gerritbot added a project: Patch-For-Review.Nov 29 2022, 10:42 AM
gerritbot added a comment.Nov 29 2022, 12:01 PM

Change 861821 merged by Vgutierrez:

[operations/puppet@production] restbase-beta: Change wikifeeds URI for deployment prep

https://gerrit.wikimedia.org/r/861821

Maintenance_bot removed a project: Patch-For-Review.Nov 29 2022, 12:29 PM
dancy unsubscribed.Nov 29 2022, 4:02 PM
Andrew updated the task description. (Show Details)Dec 6 2022, 6:08 PM
Andrew updated the task description. (Show Details)
Andrew added a subscriber: dancy.
Andrew mentioned this in T294148: Replace deployment-imagescaler03 (stretch) with deployment-imagescaler04 (buster).Dec 6 2022, 6:15 PM
TheresNoTime mentioned this in T324695: beta-prometheus.wmflabs.org 502 Bad Gateway.Dec 7 2022, 5:53 PM
TheresNoTime mentioned this in T324782: Replace deployment-prometheus02.Dec 8 2022, 6:39 PM
Andrew subscribed.Jan 17 2023, 10:08 PM

We have several Stretch VMs that have been shutoff for quite some time:

  1. deployment-echostore01.deployment-prep.eqiad1.wikimedia.cloud
  2. deployment-mdb01.deployment-prep.eqiad1.wikimedia.cloud
  3. deployment-ms-fe03.deployment-prep.eqiad1.wikimedia.cloud
  4. deployment-prometheus02.deployment-prep.eqiad1.wikimedia.cloud
  5. deployment-wikifeeds01.deployment-prep.eqiad1.wikimedia.cloud

I am going to delete those in a day or two if no one protests.

deployment-imagescaler03 is the last running Stretch VM in this project.

taavi closed this task as Resolved.Feb 24 2023, 3:54 PM
taavi closed subtask T278641: Migrate deployment-prep away from Debian Stretch to Buster/Bullseye as Resolved.
In T289883#8644474, @Stashbot wrote:

Mentioned in SAL (#wikimedia-cloud) [2023-02-24T15:26:57Z] <andrewbogott> deleting long-shutoff stretch instance deployment-imagescaler03.deployment-prep.eqiad1.wikimedia.cloud -- T289883

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits