Page MenuHomePhabricator
Create Task
Maniphest T271573

upgrade conf2* servers to buster
Closed, ResolvedPublic
Actions

Description

Currently the conf* (configcluster) servers in eqiad are on stretch but the ones in codfw are still on jessie.

There are 2 separate roles, configcluster and configcluster_stretch applied to them.

We should reimage the jessie machines with stretch and make them use the same role so that .. we get rid of jessie and servers are the same across both DCs.

Noticed this when confirming an unrelated change as noop and seeing these kinds of puppet error on conf2001:

Error: /Stage[main]/Apt/File[/usr/local/share/apt/base_packages.txt]: Could not evaluate: Could not retrieve information from environment production source(s) puppet:///modules/apt/base_packages.jessie

APT base packages have not been generated for jessie anymore. So this is starting to cause other issues. The puppet run does still finish though.

Details

SubjectRepoBranchLines +/-
prometheus: Clean up absent file resourceoperations/puppetproduction+0 -9
puppet_compiler: Remove etcd and conftool::clientoperations/puppetproduction+0 -16
Remove unused profile::etcd and related classesoperations/puppetproduction+0 -403
Rename role configcluster_stretch to configclusteroperations/puppetproduction+46 -113
Rename configcluster_stretch to configcluster in hieraoperations/puppetproduction+23 -67
configcluster: Enable etcd v2 backupsoperations/puppetproduction+16 -0
Remove references to conf200[1-3] after decomoperations/puppetproduction+3 -27
Switch conf200[1-3] to conf200[4-6]operations/puppetproduction+10 -7
Move codfw etcd clients to new clusteroperations/dnsmaster+9 -9
common: Remove old zookeeper hostsoperations/puppetproduction+0 -6
configcluster: No longer include zookeeper in old configcluster roleoperations/puppetproduction+0 -5
Swap zookeeper from conf2003 to conf2006operations/puppetproduction+3 -6
Swap zookeeper from conf2002 to conf2005operations/puppetproduction+2 -2
configcluster: Update zookeeper version to debian upstreamoperations/puppetproduction+2 -1
Swap zookeeper from conf2001 to conf2004operations/puppetproduction+2 -2
configcluster: Enable replication on conf2005operations/puppetproduction+2 -0
configcluster: Add new tlsproxy certificateoperations/puppetproduction+29 -0
Add new tlsproxy cert for configcluster etcdlabs/privatemaster+3 -0
Add conf200[4-6] IPs to zookeeper's main firewall configoperations/puppetproduction+6 -0
Repackaging for busteroperations/software/etcd-mirrordebian+7 -0
Setup new etcd3 cluster on conf200[456] in codfwoperations/puppetproduction+45 -6
Add SRV records for new etcd3 cluster in codfwoperations/dnsmaster+6 -2
htpasswd(): salt must be 8 characterslabs/privatemaster+2 -2
Add key for _etcd-server-ssl._tcp.v3.codfw.wmnet.keylabs/privatemaster+0 -0
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
• jcrespo added a comment.Jan 28 2021, 12:46 PM

Sorry to bother you, but do you happen to know when this upgrade will happen? I am not blocked by it (so please don't change any plans because of my question), but depending on when it is probably going to happen (e.g. if it is scheduled soon or will take a bit more) I would solve jessie backups blocker in different ways: T273182

• MoritzMuehlenhoff subscribed.Jan 28 2021, 2:10 PM
• jcrespo mentioned this in T273182: Revert OpenSSL min version configuration introduced for bacula compatibility.Feb 1 2021, 3:00 PM
• jcrespo added a parent task: T273182: Revert OpenSSL min version configuration introduced for bacula compatibility.

I just realized, after closer inspection, that the blocker is indeed real, and we need these in stretch or higher to revert T273182. Is there something I can do to help?

• jcrespo added a comment.Feb 1 2021, 3:41 PM

See also related T224560

elukey added a comment.Feb 1 2021, 6:40 PM

@jcrespo me and Giuseppe are discussing the problem, so your pings are not unseen, but the problem is complex since it requires a lot of clients to move to eqiad first (Pybals, etcd DNS configs, etc..). The main question mark is around the shape of the etcd cluster, but we should have some answers during the next days. The ETA for the upgrade is in the order of few weeks I fear (to write a plan, find the time, execute it, etc..) , how does it look from your side? If it is too impacting we could try to figure out a workaround for these nodes :(

• jcrespo added a comment.Feb 2 2021, 9:57 AM

If it is too impacting we could try to figure out a workaround for these nodes :(

How bad would it be to disable monitoring of backups (and backups to fail) of these (but keeping the backups of conf1*) until they are upgraded? The problem with backing up jessie hosts is that they force the downgrade of all hosts to use TLS1.0, which is not great, specially cross-dc.

elukey added a comment.Feb 4 2021, 7:25 AM

If we keep the backups for conf1* it should be fine, conf2* replicates via etcdmirror from conf100*, so if this unblocks you it should be doable. Let's check with @Joe to be sure :)

• jcrespo added a comment.Feb 4 2021, 10:05 AM

Let's make sure this is true, and only canonical data will be on conf100* before moving ahead with that, otherwise I prefer to get blocked and speed up the upgrade.

gerritbot added a comment.Feb 15 2021, 5:28 PM

Change 664313 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] configcluster: Enable etcd v3 backups for stretch hosts

https://gerrit.wikimedia.org/r/664313

gerritbot added a project: Patch-For-Review.Feb 15 2021, 5:28 PM
• jcrespo added a comment.Feb 15 2021, 5:41 PM

I've sent:
https://gerrit.wikimedia.org/r/c/operations/puppet/+/664313

Independently of the pace of upgrading, we should give some priority to generating fresh backups from the (more?) active cluster?

• jcrespo mentioned this in T274808: Implement production zookeeper backups.Feb 15 2021, 5:54 PM
elukey added a subscriber: • wkandek.Feb 16 2021, 10:29 AM

@wkandek Hi! Do you think that we could find somebody in your team to work with me on this task? It seems very important and potentially blocking others (also the hosts are still running Jessie sigh).

Joe added a subscriber: JMeybohm.Feb 24 2021, 9:57 AM
In T271573#6832845, @elukey wrote:

@wkandek Hi! Do you think that we could find somebody in your team to work with me on this task? It seems very important and potentially blocking others (also the hosts are still running Jessie sigh).

Hi, me and @JMeybohm will work on this with you. We had a knowledge dump meeting this morning, and while doing so we came up with a better plan than the one I outlined first:

  1. Wait until we have procured the new servers T271346
  2. Add a DNS SRV entry for cluster discovery for those new machines for etcd
  3. Install them with buster and apply the configcluster_stretch (yeah I know...) role, where we'll add a switch to avoid starting zookeeper on these machines at first
  4. Check that the etcd cluster works as designed, add replication
  5. Switch read traffic for etcd from the old to the new cluster
  6. Proceed with the migration of zookeeper one server at a time

How does that sound?

gerritbot added a comment.Apr 15 2021, 9:36 AM

Change 679727 had a related patch set uploaded (by JMeybohm; author: JMeybohm):

[operations/puppet@production] Setup new etcd3 cluster on conf200[456] in codfw

https://gerrit.wikimedia.org/r/679727

gerritbot added a comment.Apr 15 2021, 9:44 AM

Change 679731 had a related patch set uploaded (by JMeybohm; author: JMeybohm):

[operations/dns@master] Add SRV records for new etcd3 cluster in codfw

https://gerrit.wikimedia.org/r/679731

gerritbot added a comment.Apr 15 2021, 9:53 AM

Change 679734 had a related patch set uploaded (by JMeybohm; author: JMeybohm):

[labs/private@master] Add key for _etcd-server-ssl._tcp.v3.codfw.wmnet.key

https://gerrit.wikimedia.org/r/679734

gerritbot added a comment.Apr 15 2021, 10:27 AM

Change 679734 merged by JMeybohm:

[labs/private@master] Add key for _etcd-server-ssl._tcp.v3.codfw.wmnet.key

https://gerrit.wikimedia.org/r/679734

gerritbot added a comment.Apr 15 2021, 10:34 AM

Change 679748 had a related patch set uploaded (by JMeybohm; author: JMeybohm):

[labs/private@master] htpasswd(): salt must be 8 characters

https://gerrit.wikimedia.org/r/679748

gerritbot added a comment.Apr 15 2021, 10:35 AM

Change 679748 merged by JMeybohm:

[labs/private@master] htpasswd(): salt must be 8 characters

https://gerrit.wikimedia.org/r/679748

JMeybohm mentioned this in rLPRI0b84184cb07d: Add key for _etcd-server-ssl._tcp.v3.codfw.wmnet.key.Apr 15 2021, 10:39 AM
JMeybohm mentioned this in rLPRI249ea28e2e35: htpasswd(): salt must be 8 characters.
gerritbot added a comment.Apr 15 2021, 11:04 AM

Change 679731 merged by JMeybohm:

[operations/dns@master] Add SRV records for new etcd3 cluster in codfw

https://gerrit.wikimedia.org/r/679731

gerritbot added a comment.Apr 15 2021, 11:18 AM

Change 679727 merged by JMeybohm:

[operations/puppet@production] Setup new etcd3 cluster on conf200[456] in codfw

https://gerrit.wikimedia.org/r/679727

gerritbot added a comment.Apr 15 2021, 11:44 AM

Change 679770 had a related patch set uploaded (by JMeybohm; author: JMeybohm):

[operations/software/etcd-mirror@debian] Repackaging for buster

https://gerrit.wikimedia.org/r/679770

gerritbot added a comment.Apr 15 2021, 2:40 PM

Change 679770 abandoned by JMeybohm:

[operations/software/etcd-mirror@debian] Repackaging for buster

Reason:

https://gerrit.wikimedia.org/r/679770

JMeybohm claimed this task.Apr 16 2021, 9:05 AM

etcd cluster is set up now on conf200[4,5,6] although I had some trouble setting it up and I do not yet know why:

After the initial puppet runs, the ectd's rejected each others certificate for weird reasons:

Apr 16 08:28:57 conf2004 etcd[20404]: rejected connection from "10.192.48.59:49538" (error "remote error: tls: bad certificate", ServerName "v3.codfw.wmnet")
Apr 16 08:28:57 conf2004 etcd[20404]: rejected connection from "10.192.48.59:49536" (error "remote error: tls: bad certificate", ServerName "v3.codfw.wmnet")

Where 10.192.48.59 is conf2006.

Apr 16 08:28:38 conf2006 etcd[13177]: health check for peer d421c441462980ef could not connect: x509: certificate is valid for conf2004.codfw.wmnet, conf2005.codfw.wmnet, conf2006.codfw.wmnet, _etcd-server-ssl._tcp.v3.codfw.wmnet, not v3.codfw.wmnet (prober "ROUND_TRIPPER_SNAPSHOT")
Apr 16 08:28:38 conf2006 etcd[13177]: health check for peer d421c441462980ef could not connect: x509: certificate is valid for conf2004.codfw.wmnet, conf2005.codfw.wmnet, conf2006.codfw.wmnet, _etcd-server-ssl._tcp.v3.codfw.wmnet, not v3.codfw.wmnet (prober "ROUND_TRIPPER_RAFT_MESSAGE")

v3.codfw.wmnet is clearly not in the certificates (and it should not be), but _etcd-server-ssl._tcp.v3.codfw.wmnet is. According to s_client the correct certs where used when connecting (DNS:conf2004.codfw.wmnet, DNS:conf2005.codfw.wmnet, DNS:conf2006.codfw.wmnet, DNS:_etcd-server-ssl._tcp.v3.codfw.wmnet).

To enable debug I restarted etcd and out of a sudden the nodes where happily joining...
If someone has a clue, please point me into the right direction.

• jcrespo added a comment.Apr 16 2021, 9:12 AM

Do you think, with the work done, we could drop support of jessie bacula backups (only etcd cluster was pending with jessie)?

JMeybohm added a comment.Apr 16 2021, 9:16 AM
In T271573#7008274, @jcrespo wrote:

Do you think, with the work done, we could drop support of jessie bacula backups (only etcd cluster was pending with jessie)?

If those are the last jessie nodes I guess so. But migration is not done yet (just a new, empty etcd cluster). We'll let you know when we've taken the jessie nodes out of service.

JMeybohm added a comment.Apr 16 2021, 1:56 PM

The tlsproxy currently serves a certificate not valid for conf200[4,5,6] (Prometheus errors with: Get https://conf2004:4001/metrics: x509: certificate is valid for conf2001.codfw.wmnet, conf2002.codfw.wmnet, conf2003.codfw.wmnet, conf2001, conf2002, conf2003, etcd.codfw.wmnet, not conf2004)

This is because I overlooked the fact that I need to re-create the etcd certificate:

# This cert is generated using puppet-ecdsacert, and includes
# all the hostnames for the etcd machines in the SANs
# Will need to be regenerated if we add servers to the cluster.
profile::etcd::tlsproxy::cert_name: "etcd.%{::domain}"
gerritbot added a comment.Apr 19 2021, 6:34 AM

Change 680874 had a related patch set uploaded (by Elukey; author: Elukey):

[operations/puppet@production] Add conf200[4-6] IPs to zookeeper's main firewall config

https://gerrit.wikimedia.org/r/680874

gerritbot added a comment.Apr 19 2021, 6:34 AM

Change 680875 had a related patch set uploaded (by Elukey; author: Elukey):

[operations/puppet@production] Swap zookeeper from conf2001 to conf2004

https://gerrit.wikimedia.org/r/680875

elukey added a comment.Apr 19 2021, 7:45 AM

@JMeybohm I created the first two patch to swap the zookeeper servers, in theory it should work fine. The delicate step is the roll restart of the daemons after the second one, but it should be ok. If you want we can review them together and decide how to proceed :)

gerritbot added a comment.Apr 19 2021, 12:53 PM

Change 680874 merged by Elukey:

[operations/puppet@production] Add conf200[4-6] IPs to zookeeper's main firewall config

https://gerrit.wikimedia.org/r/680874

gerritbot added a comment.Apr 26 2021, 7:08 AM

Change 682403 had a related patch set uploaded (by JMeybohm; author: JMeybohm):

[labs/private@master] Add new tlsproxy cert for configcluster etcd

https://gerrit.wikimedia.org/r/682403

gerritbot added a comment.Apr 26 2021, 7:16 AM

Change 682493 had a related patch set uploaded (by JMeybohm; author: JMeybohm):

[operations/puppet@production] configcluster: Add new tlsproxy certificate

https://gerrit.wikimedia.org/r/682493

gerritbot added a comment.Apr 26 2021, 7:21 AM

Change 682403 merged by JMeybohm:

[labs/private@master] Add new tlsproxy cert for configcluster etcd

https://gerrit.wikimedia.org/r/682403

JMeybohm mentioned this in rLPRId9cc3fb9a258: Add new tlsproxy cert for configcluster etcd.Apr 26 2021, 7:23 AM
gerritbot added a comment.Apr 26 2021, 7:24 AM

Change 682493 merged by JMeybohm:

[operations/puppet@production] configcluster: Add new tlsproxy certificate

https://gerrit.wikimedia.org/r/682493

gerritbot added a comment.Apr 26 2021, 7:52 AM

Change 682497 had a related patch set uploaded (by JMeybohm; author: JMeybohm):

[operations/puppet@production] configcluster: Enable replication on conf2005

https://gerrit.wikimedia.org/r/682497

ops-monitoring-bot added a comment.Apr 26 2021, 7:54 AM

Icinga downtime set by jayme@cumin1001 for 1:00:00 1 host(s) and their services with reason: for initial etcd replication

conf2005.codfw.wmnet
ops-monitoring-bot added a comment.Apr 26 2021, 9:15 AM

Icinga downtime set by jayme@cumin1001 for 1:00:00 1 host(s) and their services with reason: for initial etcd replication

conf2005.codfw.wmnet
gerritbot added a comment.Apr 26 2021, 9:17 AM

Change 682497 merged by JMeybohm:

[operations/puppet@production] configcluster: Enable replication on conf2005

https://gerrit.wikimedia.org/r/682497

ops-monitoring-bot added a comment.Apr 26 2021, 1:28 PM

Icinga downtime set by jayme@cumin1001 for 2:00:00 6 host(s) and their services with reason: for zookeeper migration

conf[2001-2006].codfw.wmnet
gerritbot added a comment.Apr 26 2021, 1:29 PM

Change 680875 merged by JMeybohm:

[operations/puppet@production] Swap zookeeper from conf2001 to conf2004

https://gerrit.wikimedia.org/r/680875

gerritbot added a comment.Apr 26 2021, 1:39 PM

Change 682655 had a related patch set uploaded (by JMeybohm; author: JMeybohm):

[operations/puppet@production] configcluster: Update zookeeper version to debian upstream

https://gerrit.wikimedia.org/r/682655

gerritbot added a comment.Apr 26 2021, 1:42 PM

Change 682655 merged by JMeybohm:

[operations/puppet@production] configcluster: Update zookeeper version to debian upstream

https://gerrit.wikimedia.org/r/682655

ops-monitoring-bot added a comment.Apr 26 2021, 2:03 PM

Icinga downtime set by jayme@cumin1001 for 1 day, 0:00:00 1 host(s) and their services with reason: for zookeeper migration

conf2001.codfw.wmnet
gerritbot added a comment.Apr 26 2021, 2:11 PM

Change 682666 had a related patch set uploaded (by JMeybohm; author: JMeybohm):

[operations/puppet@production] Swap zookeeper from conf2002 to conf2005

https://gerrit.wikimedia.org/r/682666

gerritbot added a comment.Apr 26 2021, 2:11 PM

Change 682667 had a related patch set uploaded (by JMeybohm; author: JMeybohm):

[operations/puppet@production] Swap zookeeper from conf2003 to conf2006

https://gerrit.wikimedia.org/r/682667

JMeybohm added a comment.Apr 26 2021, 2:15 PM

Switched zookeeper from conf2001 to conf2004.
We decided to leave it like this for today and see if anything comes up.

gerritbot added a comment.Apr 26 2021, 2:28 PM

Change 682669 had a related patch set uploaded (by JMeybohm; author: JMeybohm):

[operations/puppet@production] configcluster: No longer include zookeeper in old configcluster role

https://gerrit.wikimedia.org/r/682669

ops-monitoring-bot added a comment.Apr 27 2021, 7:19 AM

Icinga downtime set by jayme@cumin1001 for 1 day, 0:00:00 2 host(s) and their services with reason: for zookeeper migration

conf[2002-2003].codfw.wmnet
ops-monitoring-bot added a comment.Apr 27 2021, 7:21 AM

Icinga downtime set by jayme@cumin1001 for 2:00:00 3 host(s) and their services with reason: for zookeeper migration

conf[2004-2006].codfw.wmnet
gerritbot added a comment.Apr 27 2021, 7:24 AM

Change 682666 merged by JMeybohm:

[operations/puppet@production] Swap zookeeper from conf2002 to conf2005

https://gerrit.wikimedia.org/r/682666

ops-monitoring-bot added a comment.Apr 27 2021, 1:07 PM

Icinga downtime set by jayme@cumin1001 for 2:00:00 3 host(s) and their services with reason: for zookeeper migration

conf[2004-2006].codfw.wmnet
gerritbot added a comment.Apr 27 2021, 1:09 PM

Change 682667 merged by JMeybohm:

[operations/puppet@production] Swap zookeeper from conf2003 to conf2006

https://gerrit.wikimedia.org/r/682667

JMeybohm added a comment.Apr 27 2021, 3:30 PM

Zookeeper has completely moved from conf200[1-3] to conf200[4-6], kafka-main, mirror-maker and kafka-logging in codfw have been restarted to catch up with that as well.

gerritbot added a comment.Apr 28 2021, 7:38 AM

Change 682669 merged by JMeybohm:

[operations/puppet@production] configcluster: No longer include zookeeper in old configcluster role

https://gerrit.wikimedia.org/r/682669

gerritbot added a comment.Apr 28 2021, 9:32 AM

Change 683244 had a related patch set uploaded (by JMeybohm; author: JMeybohm):

[operations/dns@master] Move codfw etcd clients to new cluster

https://gerrit.wikimedia.org/r/683244

gerritbot added a comment.Apr 28 2021, 9:46 AM

Change 683246 had a related patch set uploaded (by JMeybohm; author: JMeybohm):

[operations/puppet@production] common: Remove old zookeer hosts

https://gerrit.wikimedia.org/r/683246

gerritbot added a comment.Apr 28 2021, 9:55 AM

Change 683248 had a related patch set uploaded (by JMeybohm; author: JMeybohm):

[operations/puppet@production] Switch conf200[1-3] to conf200[4-6]

https://gerrit.wikimedia.org/r/683248

gerritbot added a comment.Apr 28 2021, 10:02 AM

Change 683246 merged by JMeybohm:

[operations/puppet@production] common: Remove old zookeeper hosts

https://gerrit.wikimedia.org/r/683246

gerritbot added a comment.Apr 28 2021, 11:50 AM

Change 683244 merged by JMeybohm:

[operations/dns@master] Move codfw etcd clients to new cluster

https://gerrit.wikimedia.org/r/683244

Stashbot added a comment.Apr 28 2021, 12:39 PM

Mentioned in SAL (#wikimedia-operations) [2021-04-28T12:39:21Z] <jayme> restarting pybal on lvs2010 - T271573

Stashbot added a comment.Apr 28 2021, 12:42 PM

Mentioned in SAL (#wikimedia-operations) [2021-04-28T12:42:03Z] <jayme> restarting pybal on lvs5003,lvs4007 - T271573

Stashbot added a comment.Apr 28 2021, 12:48 PM

Mentioned in SAL (#wikimedia-operations) [2021-04-28T12:48:07Z] <jayme> restarting pybal on lvs2009 - T271573

gerritbot added a comment.Apr 28 2021, 12:51 PM

Change 683248 merged by JMeybohm:

[operations/puppet@production] Switch conf200[1-3] to conf200[4-6]

https://gerrit.wikimedia.org/r/683248

Stashbot added a comment.Apr 28 2021, 1:10 PM

Mentioned in SAL (#wikimedia-operations) [2021-04-28T13:10:42Z] <jayme> restarting pybal on lvs5002,lvs4006,lvs2008 - T271573

Stashbot added a comment.Apr 28 2021, 1:15 PM

Mentioned in SAL (#wikimedia-operations) [2021-04-28T13:15:00Z] <jayme> restarting pybal on lvs5001,lvs4005,lvs2007 - T271573

JMeybohm added a comment.Apr 28 2021, 1:52 PM

DNS SRV records, pybal's and confd instances in codfw, eqsin, ulsfo moved to the new cluster. navtiming.service on webperf needed a restart as well.

JMeybohm added a subtask: T281374: decommission conf200[1-3].codfw.wmnet.Apr 28 2021, 2:42 PM
gerritbot added a comment.Apr 28 2021, 3:31 PM

Change 683358 had a related patch set uploaded (by JMeybohm; author: JMeybohm):

[operations/puppet@production] Remove references to conf200[1-3] after decom

https://gerrit.wikimedia.org/r/683358

gerritbot added a comment.Apr 28 2021, 3:39 PM

Change 683358 merged by JMeybohm:

[operations/puppet@production] Remove references to conf200[1-3] after decom

https://gerrit.wikimedia.org/r/683358

gerritbot added a comment.Apr 29 2021, 8:16 AM

Change 664313 merged by JMeybohm:

[operations/puppet@production] configcluster: Enable etcd v2 backups

https://gerrit.wikimedia.org/r/664313

• jcrespo removed a parent task: T273182: Revert OpenSSL min version configuration introduced for bacula compatibility.Apr 29 2021, 8:18 AM
JMeybohm closed this task as Resolved.Apr 29 2021, 8:26 AM
gerritbot added a comment.Apr 29 2021, 8:50 AM

Change 683551 had a related patch set uploaded (by JMeybohm; author: JMeybohm):

[operations/puppet@production] Rename role configcluster_stretch to configcluster

https://gerrit.wikimedia.org/r/683551

gerritbot added a comment.May 3 2021, 10:13 AM

Change 684315 had a related patch set uploaded (by JMeybohm; author: JMeybohm):

[operations/puppet@production] Rename configcluster_stretch to configcluster in hiera

https://gerrit.wikimedia.org/r/684315

gerritbot added a comment.May 3 2021, 10:13 AM

Change 684316 had a related patch set uploaded (by JMeybohm; author: JMeybohm):

[operations/puppet@production] Remove unused profile::etcd and related classes

https://gerrit.wikimedia.org/r/684316

• jcrespo awarded a token.May 3 2021, 10:14 AM
gerritbot added a comment.May 3 2021, 2:12 PM

Change 684315 abandoned by JMeybohm:

[operations/puppet@production] Rename configcluster_stretch to configcluster in hiera

Reason:

Squashed into 683551

https://gerrit.wikimedia.org/r/684315

Dzahn awarded a token.May 4 2021, 12:37 AM
gerritbot added a comment.May 4 2021, 8:05 AM

Change 683551 merged by JMeybohm:

[operations/puppet@production] Rename role configcluster_stretch to configcluster

https://gerrit.wikimedia.org/r/683551

gerritbot added a comment.May 4 2021, 8:05 AM

Change 684316 merged by JMeybohm:

[operations/puppet@production] Remove unused profile::etcd and related classes

https://gerrit.wikimedia.org/r/684316

gerritbot added a comment.May 4 2021, 8:43 AM

Change 684801 had a related patch set uploaded (by JMeybohm; author: JMeybohm):

[operations/puppet@production] prometheus: Clean up absent file resource

https://gerrit.wikimedia.org/r/684801

gerritbot added a comment.May 4 2021, 9:57 AM

Change 684848 had a related patch set uploaded (by JMeybohm; author: JMeybohm):

[operations/puppet@production] puppet_compiler: Remove etcd and conftool::client

https://gerrit.wikimedia.org/r/684848

gerritbot added a comment.May 4 2021, 10:32 AM

Change 684848 merged by JMeybohm:

[operations/puppet@production] puppet_compiler: Remove etcd and conftool::client

https://gerrit.wikimedia.org/r/684848

Papaul closed subtask T281374: decommission conf200[1-3].codfw.wmnet as Resolved.May 4 2021, 8:14 PM
gerritbot added a comment.May 11 2021, 7:35 AM

Change 684801 merged by JMeybohm:

[operations/puppet@production] prometheus: Clean up absent file resource

https://gerrit.wikimedia.org/r/684801

JMeybohm mentioned this in T224560: Migrate Zookeeper/etcd conf cluster in codfw to Buster.Jun 7 2022, 11:47 AM
JMeybohm renamed this task from upgrade conf2* servers to stretch to upgrade conf2* servers to buster.Jun 7 2022, 11:51 AM
JMeybohm mentioned this in T310062: Update conf1* servers.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits