Page MenuHomePhabricator

Bootstrap new Cassandra nodes (eqiad)
Open, MediumPublic

Description

Add aqs1016-aqs1021 to the AQS Cassandra cluster.

  • aqs1016-a
  • aqs1016-b
  • aqs1017-a
  • aqs1017-b
  • aqs1018-a
  • aqs1018-b
  • aqs1019-a
  • aqs1019-b
  • aqs1020-a
  • aqs1020-b
  • aqs1021-a
  • aqs1021-b

After the bootstraps are complete, each instance will need it's stream throughput reset to 200Mb/s, and a cleanup operation initiated:

  • aqs1010-{a,b}
  • aqs1013-{a,b}
  • aqs1016-{a,b}
  • aqs1019-{a,b}
  • aqs1011-{a,b}
  • aqs1014-{a,b}
  • aqs1017-{a,b}
  • aqs1020-{a,b}
  • aqs1012-{a,b}
  • aqs1015-{a,b}
  • aqs1018-{a,b}
  • aqs1021-{a,b}

See: T305570

Event Timeline

Change 812426 had a related patch set uploaded (by Eevans; author: Eevans):

[operations/puppet@production] [DRAFT]: Bootstrap new AQS Cassandra nodes (eqiad)

https://gerrit.wikimedia.org/r/812426

Change 812426 merged by Eevans:

[operations/puppet@production] Bootstrap new AQS Cassandra nodes (eqiad)

https://gerrit.wikimedia.org/r/812426

Mentioned in SAL (#wikimedia-operations) [2022-11-10T17:26:49Z] <urandom> increasing stream throughput to 400mbit, aqs1011-{a,b} & aqs1013-{a,b} -- T307802

Mentioned in SAL (#wikimedia-operations) [2022-11-10T17:28:19Z] <urandom> restarting bootstrap of aqs1016-a -- T307802

Mentioned in SAL (#wikimedia-operations) [2022-11-12T22:46:58Z] <urandom> initiating bootstrap, aqs1016-b -- T307802

Mentioned in SAL (#wikimedia-operations) [2022-11-14T15:13:01Z] <urandom> initiating Cassandra bootstrap, aqs1019-a -- T307802

Mentioned in SAL (#wikimedia-operations) [2022-11-15T16:14:40Z] <urandom> initiating Cassandra bootstrap, aqs1019-b -- T307802

Mentioned in SAL (#wikimedia-operations) [2022-11-16T15:39:33Z] <urandom> initiating Cassandra bootstrap, aqs1017-a -- T307802

Mentioned in SAL (#wikimedia-operations) [2022-11-18T14:30:15Z] <urandom> initiating Cassandra bootstrap, aqs1017-b -- T307802

Mentioned in SAL (#wikimedia-operations) [2022-11-19T21:41:09Z] <urandom> initiating Cassandra bootstrap, aqs1020-a -- T307802

Mentioned in SAL (#wikimedia-operations) [2022-11-20T20:29:00Z] <urandom> initiating Cassandra bootstrap, aqs1020-b -- T307802

Mentioned in SAL (#wikimedia-operations) [2022-11-21T15:16:06Z] <urandom> initiating Cassandra bootstrap, aqs1018-a -- T307802

Mentioned in SAL (#wikimedia-operations) [2022-11-23T17:39:57Z] <urandom> initiating Cassandra bootstrap, aqs1018-a -- T307802

Mentioned in SAL (#wikimedia-operations) [2022-11-25T17:38:35Z] <urandom> initiating Cassandra bootstrap, aqs1021-a -- T307802

Mentioned in SAL (#wikimedia-operations) [2022-11-26T21:34:04Z] <urandom> initiating Cassandra bootstrap, aqs1021-b -- T307802