Page MenuHomePhabricator

Cmjohnson (cmjohnson)
User

Projects (11)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Thursday

  • Clear sailing ahead.

User Details

User Since
Dec 16 2014, 10:22 PM (289 w, 6 d)
Availability
Available
IRC Nick
cmjohnson1
LDAP User
Cmjohnson
MediaWiki User
Unknown

Recent Activity

Yesterday

Cmjohnson added a comment to T251619: (Need By: 2020-06-20) rack/setup/install cloudcephosd10[04-15].wikimedia.org.

The network switches still need to be connected to the network, in the meantime, everything will be completed so they can be imaged

Mon, Jul 6, 8:30 PM · cloud-services-team (Hardware), ops-eqiad, DC-Ops, Operations
Cmjohnson updated the task description for T251619: (Need By: 2020-06-20) rack/setup/install cloudcephosd10[04-15].wikimedia.org.
Mon, Jul 6, 8:29 PM · cloud-services-team (Hardware), ops-eqiad, DC-Ops, Operations

Thu, Jul 2

Cmjohnson added a comment to T255520: (Due By: 2020-07-17) rack/setup/install <hadoop testing nodes>.

an-test-master1001
Rack A5 Port 30

Thu, Jul 2, 4:16 PM · ops-eqiad, Operations, DC-Ops
Cmjohnson added a comment to T241791: (Need by: 2020-04-02) rack/setup/install relforge100[34].

@Gehel @wiki_willy each relforge has 4 ssds

Thu, Jul 2, 3:18 PM · Patch-For-Review, ops-eqiad, Discovery-Search (Current work), Operations
Cmjohnson updated subscribers of T255072: (Due By: 2020-07-25) rack/setup/install alert1001.

@fgiunchedi icinga1001 is in rack C8, that is now a 10G rack. Do you still want this server there or can we move to another rack that is 1G only and eventually migrate icinga1001 to the same rack?

Thu, Jul 2, 3:09 PM · Operations, ops-eqiad, DC-Ops

Tue, Jun 30

Cmjohnson added a comment to T225121: (Need by: 2019-09-30) upgrade msw1-eqiad from EX4200 to EX4300.

new-msw1-eqiad has the correct JUNOS 18.1.3 and the configuration has been copied. Currently connected to port 2 on the a8-scs and can be moved to the correct port once we 100% migrate to the new switch.

Tue, Jun 30, 6:14 PM · netops, Operations, ops-eqiad
Cmjohnson updated the task description for T225121: (Need by: 2019-09-30) upgrade msw1-eqiad from EX4200 to EX4300.
Tue, Jun 30, 6:12 PM · netops, Operations, ops-eqiad
Cmjohnson added a comment to T241791: (Need by: 2020-04-02) rack/setup/install relforge100[34].

@Gehel I am getting a partman error. Is the partman recipe given correct? The raid10-4dev is not working.

Tue, Jun 30, 5:01 PM · Patch-For-Review, ops-eqiad, Discovery-Search (Current work), Operations

Thu, Jun 25

Cmjohnson reassigned T241791: (Need by: 2020-04-02) rack/setup/install relforge100[34] from Cmjohnson to Dzahn.

@Dzahn Could you try to image one of these and let me know if you see a setting missed. I am able to login to the ilo via mgmt network but when I use the install script on cumin I am getting an IPMI connection error.

Thu, Jun 25, 6:34 PM · Patch-For-Review, ops-eqiad, Discovery-Search (Current work), Operations
Cmjohnson added a comment to T225121: (Need by: 2019-09-30) upgrade msw1-eqiad from EX4200 to EX4300.

This is being worked on, I had to put the OS image back on the usb stick. When I reset the switch to factory default the usb was wiped as welll.

Thu, Jun 25, 6:32 PM · netops, Operations, ops-eqiad

Mon, Jun 22

Cmjohnson added a comment to T241791: (Need by: 2020-04-02) rack/setup/install relforge100[34].

I am having an issue with these. While running the script it gives me an error about IPMI. These are HP servers and I do not know of any manual IPMI setting.

Mon, Jun 22, 5:01 PM · Patch-For-Review, ops-eqiad, Discovery-Search (Current work), Operations
Cmjohnson moved T255406: decommission dbproxy1008.eqiad.wmnet from Backlog to Decommission on the ops-eqiad board.
Mon, Jun 22, 5:00 PM · DC-Ops, ops-eqiad, Operations, decommission-hardware
Cmjohnson moved T255553: decommission ganeti100[1-4].eqiad.wmnet from Backlog to Decommission on the ops-eqiad board.
Mon, Jun 22, 5:00 PM · Operations, ops-eqiad, decommission-hardware

Fri, Jun 12

Cmjohnson moved T254238: decomission oresrdb100[12] from Backlog to Decommission on the ops-eqiad board.
Fri, Jun 12, 12:55 PM · Operations, ops-eqiad, DC-Ops
Cmjohnson added a comment to T253607: Degraded RAID on restbase-dev1004.

@wiki_willy I completely forgot but restbases have ssds that were purchased separately from the servers. I believe this is the task of the original purchase. T158795. Also, this is a past task for ordering ssds for Restbase-dev1006 https://phabricator.wikimedia.org/T224260.

Fri, Jun 12, 12:54 PM · ops-eqiad, Operations
Cmjohnson closed T253856: decom 36 old appservers in eqiad (onsite, dcops), a subtask of T218751: Audit down ports, as Resolved.
Fri, Jun 12, 12:50 PM · DC-Ops, Operations, ops-eqiad
Cmjohnson closed T253856: decom 36 old appservers in eqiad (onsite, dcops) as Resolved.

removed from networks switch, all dns entries removed, removed from rack and netbox has been updated to offline. Resolving this task

Fri, Jun 12, 12:50 PM · ops-eqiad, DC-Ops, serviceops, Operations
Cmjohnson closed T253856: decom 36 old appservers in eqiad (onsite, dcops), a subtask of T247780: decom old appservers in eqiad, as Resolved.
Fri, Jun 12, 12:50 PM · serviceops, Operations
Cmjohnson updated the task description for T253856: decom 36 old appservers in eqiad (onsite, dcops).
Fri, Jun 12, 12:50 PM · ops-eqiad, DC-Ops, serviceops, Operations
Cmjohnson updated the task description for T253856: decom 36 old appservers in eqiad (onsite, dcops).
Fri, Jun 12, 12:49 PM · ops-eqiad, DC-Ops, serviceops, Operations

Wed, Jun 10

Cmjohnson added a comment to T254238: decomission oresrdb100[12].

@akosiaris Have any the initial steps been completed with this decom task?

Wed, Jun 10, 2:34 PM · Operations, ops-eqiad, DC-Ops
Cmjohnson closed T239821: decommission elastic10[18-31].eqiad.wmnet, a subtask of T221630: [Epic] Search platform - Hardware requests for 2019-2020, as Resolved.
Wed, Jun 10, 2:33 PM · Discovery-Search (Current work), Epic
Cmjohnson closed T239821: decommission elastic10[18-31].eqiad.wmnet as Resolved.

All of these servers have been removed from the racks, networks switch and moved to offline in netbox

Wed, Jun 10, 2:33 PM · ops-eqiad, Discovery-Search (Current work), Operations, DC-Ops, decommission-hardware
Cmjohnson moved T252008: decommission ms-be101[678] from Backlog to Decommission on the ops-eqiad board.
Wed, Jun 10, 2:28 PM · ops-eqiad, Operations, decommission-hardware, SRE-swift-storage
Cmjohnson closed T251620: (NEED BY: 2020-06-11) rack/setup/install thanos-fe100[123].eqiad.wmnet as Resolved.

@fgiunchedi These are moved and installed. Resolving this task.

Wed, Jun 10, 2:14 PM · ops-eqiad, Operations, DC-Ops
Cmjohnson updated the task description for T251620: (NEED BY: 2020-06-11) rack/setup/install thanos-fe100[123].eqiad.wmnet.
Wed, Jun 10, 2:14 PM · ops-eqiad, Operations, DC-Ops

Tue, Jun 9

Cmjohnson closed T251618: (Need By: 2020-06-20) rack/setup/install thanos-be100[1234] as Resolved.

These are all finsihed

Tue, Jun 9, 7:37 PM · ops-eqiad, DC-Ops, Operations
Cmjohnson updated the task description for T251618: (Need By: 2020-06-20) rack/setup/install thanos-be100[1234].
Tue, Jun 9, 7:37 PM · ops-eqiad, DC-Ops, Operations
Cmjohnson added a comment to T251620: (NEED BY: 2020-06-11) rack/setup/install thanos-fe100[123].eqiad.wmnet.

Please move

Tue, Jun 9, 2:19 PM · ops-eqiad, Operations, DC-Ops
Cmjohnson added a comment to T251618: (Need By: 2020-06-20) rack/setup/install thanos-be100[1234].

Please move these 2 servers
thanos-be1002 from C2 to B2
thanos-be1004 from C4 to D7

Tue, Jun 9, 2:18 PM · ops-eqiad, DC-Ops, Operations

Mon, Jun 8

Cmjohnson added a comment to T251620: (NEED BY: 2020-06-11) rack/setup/install thanos-fe100[123].eqiad.wmnet.

thanos-fe1003 is the only one installed at the moment.

Mon, Jun 8, 11:33 PM · ops-eqiad, Operations, DC-Ops
Cmjohnson updated the task description for T251620: (NEED BY: 2020-06-11) rack/setup/install thanos-fe100[123].eqiad.wmnet.
Mon, Jun 8, 11:32 PM · ops-eqiad, Operations, DC-Ops
Cmjohnson updated the task description for T251620: (NEED BY: 2020-06-11) rack/setup/install thanos-fe100[123].eqiad.wmnet.
Mon, Jun 8, 5:31 PM · ops-eqiad, Operations, DC-Ops
Cmjohnson updated the task description for T241791: (Need by: 2020-04-02) rack/setup/install relforge100[34].
Mon, Jun 8, 12:35 PM · Patch-For-Review, ops-eqiad, Discovery-Search (Current work), Operations
Cmjohnson updated the task description for T241791: (Need by: 2020-04-02) rack/setup/install relforge100[34].
Mon, Jun 8, 12:33 PM · Patch-For-Review, ops-eqiad, Discovery-Search (Current work), Operations

Jun 4 2020

Cmjohnson closed T236187: decom cobalt, a subtask of T222391: Gerrit Hardware Upgrade (+ upgrade from jessie to stretch or buster), as Resolved.
Jun 4 2020, 9:29 PM · Patch-For-Review, Release-Engineering-Team (Development services), Release-Engineering-Team-TODO, serviceops, Operations, Gerrit
Cmjohnson closed T236187: decom cobalt, a subtask of T176774: Reimage gerrit1001 and gerrit2001 as buster, as Resolved.
Jun 4 2020, 9:29 PM · Release-Engineering-Team (Development services), Release-Engineering-Team-TODO, Gerrit, Operations
Cmjohnson closed T236187: decom cobalt as Resolved.

removed from rack, netbox updated, switch updated, removed dns (asset tag)

Jun 4 2020, 9:29 PM · DC-Ops, ops-eqiad, Operations
Cmjohnson updated the task description for T236187: decom cobalt.
Jun 4 2020, 9:28 PM · DC-Ops, ops-eqiad, Operations

Jun 2 2020

Cmjohnson closed T254258: wtp1032 bootlooping on CPU error as Resolved.

the server is out of warranty, I reseated both CPUs and cleared the system event log. The server booted okay. I will resolve this for now, please open again if the issue comes back.

Jun 2 2020, 6:54 PM · serviceops-radar, ops-eqiad, Operations
Cmjohnson added a comment to T253438: an-presto1004 down .

There is a larger issue with this server, replaced the CPU but noticed the power supplies are both failed. I could also smell burning in the server, swapped the power supplies with decom spares and they psu's started smoking and something definitely burned inside the power supply. This will be down for awhile

Jun 2 2020, 6:27 PM · Analytics-Radar, Operations, ops-eqiad

Jun 1 2020

Cmjohnson claimed T236187: decom cobalt.

This was out there lingering without the property tags. I found it and will finish the decom process.

Jun 1 2020, 6:53 PM · DC-Ops, ops-eqiad, Operations
Cmjohnson added a comment to T251618: (Need By: 2020-06-20) rack/setup/install thanos-be100[1234].

network switches are updated but they are disabled until I set up bios and image

Jun 1 2020, 6:12 PM · ops-eqiad, DC-Ops, Operations
Cmjohnson updated the task description for T251618: (Need By: 2020-06-20) rack/setup/install thanos-be100[1234].
Jun 1 2020, 6:11 PM · ops-eqiad, DC-Ops, Operations
Cmjohnson added a comment to T253607: Degraded RAID on restbase-dev1004.

the AHS log has been uploaded to HP per their request. Looks like we're going to be okay with the warranty thing

Jun 1 2020, 5:23 PM · ops-eqiad, Operations
Cmjohnson added a comment to T251620: (NEED BY: 2020-06-11) rack/setup/install thanos-fe100[123].eqiad.wmnet.

Added to network switches and put in disabled vlan until bios is set up and ready for imaging.

Jun 1 2020, 4:03 PM · ops-eqiad, Operations, DC-Ops
Cmjohnson updated the task description for T251620: (NEED BY: 2020-06-11) rack/setup/install thanos-fe100[123].eqiad.wmnet.
Jun 1 2020, 4:01 PM · ops-eqiad, Operations, DC-Ops
Cmjohnson added a comment to T241791: (Need by: 2020-04-02) rack/setup/install relforge100[34].

Network switches have been updated but I disabled the ports until after the bios is set up and ready for imaging.

Jun 1 2020, 3:11 PM · Patch-For-Review, ops-eqiad, Discovery-Search (Current work), Operations
Cmjohnson updated the task description for T241791: (Need by: 2020-04-02) rack/setup/install relforge100[34].
Jun 1 2020, 3:10 PM · Patch-For-Review, ops-eqiad, Discovery-Search (Current work), Operations
Cmjohnson updated the task description for T241791: (Need by: 2020-04-02) rack/setup/install relforge100[34].
Jun 1 2020, 3:10 PM · Patch-For-Review, ops-eqiad, Discovery-Search (Current work), Operations

May 29 2020

Cmjohnson moved T253856: decom 36 old appservers in eqiad (onsite, dcops) from Backlog to Decommission on the ops-eqiad board.
May 29 2020, 1:19 PM · ops-eqiad, DC-Ops, serviceops, Operations
Cmjohnson closed T248516: decommission bismuth.frack.eqiad.wmnet as Resolved.

removed from rack, dns removed, netbox updated.

May 29 2020, 1:17 PM · ops-eqiad, fundraising-tech-ops, Operations, decommission-hardware
Cmjohnson closed T245038: decommission americium.frack.eqiad.wmnet as Resolved.

Removed from rack, mgmt dns removed, netbox updated

May 29 2020, 1:12 PM · ops-eqiad, fundraising-tech-ops, Operations, decommission-hardware
Cmjohnson closed T245038: decommission americium.frack.eqiad.wmnet, a subtask of T242257: 2019-2020 Q3 fundraising hardware refresh and capex, as Resolved.
May 29 2020, 1:12 PM · fundraising-tech-ops
Cmjohnson updated the task description for T245038: decommission americium.frack.eqiad.wmnet.
May 29 2020, 1:09 PM · ops-eqiad, fundraising-tech-ops, Operations, decommission-hardware
Cmjohnson closed T235503: decommission rhodium as Resolved.

Removed from rack, dns removed, removed from network switch cfg, updated netbox.

May 29 2020, 12:51 PM · ops-eqiad, User-jbond, Operations, decommission-hardware
Cmjohnson updated the task description for T235503: decommission rhodium.
May 29 2020, 12:50 PM · ops-eqiad, User-jbond, Operations, decommission-hardware
Cmjohnson moved T253607: Degraded RAID on restbase-dev1004 from Backlog to Hardware Failure / Troubleshoot on the ops-eqiad board.
May 29 2020, 12:31 PM · ops-eqiad, Operations
Cmjohnson added a comment to T253607: Degraded RAID on restbase-dev1004.

@wiki_willy I submitted a ticket with HPE, we'll see what they say

May 29 2020, 12:30 PM · ops-eqiad, Operations
Cmjohnson moved T253808: db1138 (s4 master) crashed due to memory issues from Backlog to Hardware Failure / Troubleshoot on the ops-eqiad board.
May 29 2020, 12:25 PM · Wikimedia-Incident, ops-eqiad, Operations, DBA
Cmjohnson moved T253694: (Need By:TBD) rack/setup/install rows C and D new PDUs from Backlog to Racking Tasks on the ops-eqiad board.
May 29 2020, 12:24 PM · Operations, ops-eqiad, DC-Ops

May 24 2020

Cmjohnson moved T253438: an-presto1004 down from Backlog to Hardware Failure / Troubleshoot on the ops-eqiad board.
May 24 2020, 4:50 PM · Analytics-Radar, Operations, ops-eqiad
Cmjohnson added a comment to T253438: an-presto1004 down .

I submitted a ticket with Dell for a replacement CPU. SR1025619583

May 24 2020, 4:49 PM · Analytics-Radar, Operations, ops-eqiad

May 21 2020

Cmjohnson updated the task description for T239821: decommission elastic10[18-31].eqiad.wmnet.
May 21 2020, 11:44 PM · ops-eqiad, Discovery-Search (Current work), Operations, DC-Ops, decommission-hardware
Cmjohnson closed T234045: decommission elastic1017 as Resolved.
May 21 2020, 11:38 PM · ops-eqiad, Operations, decommission-hardware
Cmjohnson updated the task description for T234045: decommission elastic1017.
May 21 2020, 11:38 PM · ops-eqiad, Operations, decommission-hardware
Cmjohnson moved T239821: decommission elastic10[18-31].eqiad.wmnet from Backlog to Decommission on the ops-eqiad board.
May 21 2020, 11:37 PM · ops-eqiad, Discovery-Search (Current work), Operations, DC-Ops, decommission-hardware
Cmjohnson added a project to T239821: decommission elastic10[18-31].eqiad.wmnet: ops-eqiad.
May 21 2020, 11:37 PM · ops-eqiad, Discovery-Search (Current work), Operations, DC-Ops, decommission-hardware
Cmjohnson reopened T239821: decommission elastic10[18-31].eqiad.wmnet, a subtask of T221630: [Epic] Search platform - Hardware requests for 2019-2020, as Open.
May 21 2020, 11:17 PM · Discovery-Search (Current work), Epic
Cmjohnson reopened T239821: decommission elastic10[18-31].eqiad.wmnet as "Open".

this has not been completed

May 21 2020, 11:17 PM · ops-eqiad, Discovery-Search (Current work), Operations, DC-Ops, decommission-hardware
Cmjohnson closed T220144: Decommission labsdb1006.eqiad.wmnet and labsdb1007.eqiad.wmnet as Resolved.

Removed from rack, netbox updated

May 21 2020, 10:42 PM · ops-eqiad, Operations, decommission-hardware, Data-Services
Cmjohnson closed T220144: Decommission labsdb1006.eqiad.wmnet and labsdb1007.eqiad.wmnet, a subtask of T193264: Replace labsdb100[4567] with instances on cloudvirt1019 and cloudvirt1020, as Resolved.
May 21 2020, 10:42 PM · Scoring-platform-team, Wikilabels, cloud-services-team (Kanban), Patch-For-Review, Epic, Cloud-VPS
Cmjohnson updated the task description for T220144: Decommission labsdb1006.eqiad.wmnet and labsdb1007.eqiad.wmnet.
May 21 2020, 10:41 PM · ops-eqiad, Operations, decommission-hardware, Data-Services
Cmjohnson closed T233080: Decommission analytics1032, a subtask of T227485: Decommission analytics10[28-31,33-41], as Resolved.
May 21 2020, 9:49 PM · Analytics-Clusters, ops-eqiad, decommission-hardware, Operations
Cmjohnson closed T233080: Decommission analytics1032 as Resolved.

removed from rack, mgmt dns removed, switch ports were already removed. Updated netbox

May 21 2020, 9:49 PM · ops-eqiad, decommission-hardware, Operations
Cmjohnson updated the task description for T233080: Decommission analytics1032.
May 21 2020, 9:48 PM · ops-eqiad, decommission-hardware, Operations
Cmjohnson moved T247881: Three ports on asw2-d-eqiad are not working as expected from Hardware Failure / Troubleshoot to Blocked on the ops-eqiad board.
May 21 2020, 9:46 PM · ops-eqiad, netops, Operations

May 18 2020

Cmjohnson moved T244530: upgrade memory in ganeti100[5-8].eqiad.wmnet from Blocked to Hardware Failure / Troubleshoot on the ops-eqiad board.
May 18 2020, 7:40 PM · Operations, ops-eqiad
Cmjohnson closed T214903: labsdb1002-array1: status clarification, a subtask of T214499: wmcs: refresh hardware tracking docs, as Resolved.
May 18 2020, 3:56 PM · cloud-services-team (Kanban)
Cmjohnson closed T214903: labsdb1002-array1: status clarification as Resolved.

I removed from rack and updated netbox

May 18 2020, 3:56 PM · Operations, ops-eqiad, decommission-hardware, cloud-services-team (Kanban)
Cmjohnson updated subscribers of T251621: (Need By: ASAP) install additional SSDs into prometheus100[34].

I see on the procurement task that these were supposed to be here on the 6 May but I have not seen them. @Jclark-ctr have you received them?

May 18 2020, 3:55 PM · ops-eqiad, Operations, DC-Ops
Cmjohnson closed T248944: Decommission dbproxy1010.eqiad.wmnet as Resolved.

updated and removed

May 18 2020, 3:41 PM · Patch-For-Review, DC-Ops, ops-eqiad, decommission-hardware, Operations
Cmjohnson closed T248944: Decommission dbproxy1010.eqiad.wmnet, a subtask of T231280: Remove grants for the old dbproxy hosts from the misc databases, as Resolved.
May 18 2020, 3:41 PM · DBA
Cmjohnson closed T248944: Decommission dbproxy1010.eqiad.wmnet, a subtask of T231520: Replace labsdb (wikireplicas) dbproxies: dbproxy1010 and dbproxy1011, as Resolved.
May 18 2020, 3:41 PM · Data-Services, Operations, DBA
Cmjohnson updated the task description for T248944: Decommission dbproxy1010.eqiad.wmnet.
May 18 2020, 3:41 PM · Patch-For-Review, DC-Ops, ops-eqiad, decommission-hardware, Operations
Cmjohnson closed T251077: mw1280 correctable memory errors logged in getsel as Resolved.

Removed from rack, updated netbox, removed dns, verified no entries in site.pp or puppet.

May 18 2020, 3:30 PM · serviceops, Operations, ops-eqiad

May 13 2020

Cmjohnson updated the task description for T248516: decommission bismuth.frack.eqiad.wmnet.
May 13 2020, 7:11 PM · ops-eqiad, fundraising-tech-ops, Operations, decommission-hardware
Cmjohnson closed T245385: decommission dbproxy1007.eqiad.wmnet, a subtask of T231280: Remove grants for the old dbproxy hosts from the misc databases, as Resolved.
May 13 2020, 7:08 PM · DBA
Cmjohnson closed T245385: decommission dbproxy1007.eqiad.wmnet as Resolved.

updated netbox, removed from rack.

May 13 2020, 7:08 PM · Patch-For-Review, Operations, decommission-hardware, ops-eqiad
Cmjohnson closed T244463: Decommission dbproxy1001.eqiad.wmnet, a subtask of T231280: Remove grants for the old dbproxy hosts from the misc databases, as Resolved.
May 13 2020, 7:04 PM · DBA
Cmjohnson closed T244463: Decommission dbproxy1001.eqiad.wmnet as Resolved.

verified all entries are gone, removed from rack, updated netbox to offline

May 13 2020, 7:04 PM · Patch-For-Review, Operations, decommission-hardware, ops-eqiad
Cmjohnson updated the task description for T244463: Decommission dbproxy1001.eqiad.wmnet.
May 13 2020, 7:04 PM · Patch-For-Review, Operations, decommission-hardware, ops-eqiad
Cmjohnson closed T245384: decommission dbproxy1002.eqiad.wmnet as Resolved.

Removed server from rack, updated netbox

May 13 2020, 7:03 PM · DC-Ops, Patch-For-Review, Operations, ops-eqiad, decommission-hardware
Cmjohnson closed T245384: decommission dbproxy1002.eqiad.wmnet, a subtask of T231280: Remove grants for the old dbproxy hosts from the misc databases, as Resolved.
May 13 2020, 7:03 PM · DBA
Cmjohnson closed T146455: Decommission labsdb1002, a subtask of T128821: reclaim and return all cisco servers, as Resolved.
May 13 2020, 6:59 PM · DC-Ops, decommission-hardware, Goal, Operations
Cmjohnson closed T146455: Decommission labsdb1002 as Resolved.
May 13 2020, 6:59 PM · hardware-requests, Patch-For-Review, ops-eqiad, Operations
Cmjohnson added a comment to T146455: Decommission labsdb1002.

Checked everything and all entries removed, server is off rack, removed the storage array attached to it and set to offline and piled for sale.

May 13 2020, 6:58 PM · hardware-requests, Patch-For-Review, ops-eqiad, Operations
Cmjohnson closed T229586: decommission cp1008, cp1071, cp1072, cp1073, cp1074, cp1099 as Resolved.
May 13 2020, 6:44 PM · ops-eqiad, decommission-hardware, Operations
Cmjohnson added a comment to T229586: decommission cp1008, cp1071, cp1072, cp1073, cp1074, cp1099.

all dns and network switch records have been removed, servers have already been sold

May 13 2020, 6:44 PM · ops-eqiad, decommission-hardware, Operations
Cmjohnson closed T209181: Decommission rdb1001, rdb1002, rdb1003, rdb1004, rdb1007, rdb1008, a subtask of T206450: Reorganize our redis rdb1/rdb2 clusters, as Resolved.
May 13 2020, 6:39 PM · User-jijiki, User-Joe, Operations