Page MenuHomePhabricator

Cmjohnson (cmjohnson)
User

Projects (11)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Tuesday

  • Clear sailing ahead.

User Details

User Since
Dec 16 2014, 10:22 PM (256 w, 4 d)
Availability
Available
IRC Nick
cmjohnson1
LDAP User
Cmjohnson
MediaWiki User
Unknown

Recent Activity

Fri, Nov 15

Cmjohnson updated the task description for T237438: rack/setup/install ms-be105[7-9].eqiad.wmnet.
Fri, Nov 15, 4:08 PM · Operations, ops-eqiad

Thu, Nov 14

Cmjohnson added a comment to T236331: Degraded RAID on cloudvirt1018.

Looks like this was approved this time around, @Jclark-ctr please keep an eye out for the disk in receiving

Thu, Nov 14, 7:02 PM · ops-eqiad, Operations

Wed, Nov 13

Cmjohnson reassigned T224188: rack/setup/install (3) new osd ceph nodes from Cmjohnson to JHedden.

@JHedden What is the status of these servers, it looks like most everything is finished but the checkboxes are not complete. I believe the ops-eqiad work is finished so I am removing the tag. Please resolve this task when you see fit.

Wed, Nov 13, 5:54 PM · Operations, cloud-services-team (Kanban), Cloud-Services
Cmjohnson reassigned T228926: rack/setup/instal (4) CI ganeti nodes from Cmjohnson to Jclark-ctr.

@Jclark-ctr Can you get the network ports, please add to the task. Thanks

Wed, Nov 13, 5:50 PM · ops-eqiad, Operations
Cmjohnson updated the task description for T228926: rack/setup/instal (4) CI ganeti nodes.
Wed, Nov 13, 5:49 PM · ops-eqiad, Operations
Cmjohnson updated the task description for T234068: rack/setup/install frban1001.eqiad.wmnet.
Wed, Nov 13, 5:27 PM · Operations, fundraising-tech-ops, ops-eqiad
Cmjohnson updated the task description for T232137: rack/setup/install frnetmon1001.frack.eqiad.wmnet.
Wed, Nov 13, 5:23 PM · fundraising-tech-ops, ops-eqiad, Operations
Cmjohnson closed T215332: reimage WMF6937/mw1298, a subtask of T192457: Reallocate former image scalers, as Resolved.
Wed, Nov 13, 5:12 PM · Patch-For-Review, serviceops, Operations
Cmjohnson closed T215332: reimage WMF6937/mw1298, a subtask of T195623: request to assign wmf6937 (mw1298, former imagescaler) (now: wmf4727) as phab1002, as Resolved.
Wed, Nov 13, 5:12 PM · Patch-For-Review, Operations, hardware-requests
Cmjohnson closed T215332: reimage WMF6937/mw1298, a subtask of T196019: setup/install phab1002(WMF4727), as Resolved.
Wed, Nov 13, 5:12 PM · Patch-For-Review, ops-eqiad, Operations
Cmjohnson closed T215332: reimage WMF6937/mw1298 as Resolved.

The label has been done

Wed, Nov 13, 5:12 PM · ops-eqiad, Operations
Cmjohnson updated the task description for T237438: rack/setup/install ms-be105[7-9].eqiad.wmnet.
Wed, Nov 13, 5:01 PM · Operations, ops-eqiad
Cmjohnson added a comment to T236327: replace onboard NIC in kafka-jumbo100[1-6].

These are projected to be in eqiad Dec 5th

Wed, Nov 13, 4:23 PM · ops-eqiad, Operations, Analytics, User-Elukey
Cmjohnson closed T235124: Move kafka100[123] to logstash102[012] as Resolved.

labels updated

Wed, Nov 13, 4:23 PM · DC-Ops, Operations, ops-eqiad
Cmjohnson added a comment to T230575: Degraded RAID on cloudvirt1018.

I created another dispatch ticket with Dell and will try and resolve this through them. If not a phone call will have to be made.

Wed, Nov 13, 4:16 PM · ops-eqiad, Operations
Cmjohnson added a comment to T236601: Degraded RAID on elastic1039.

@Gehel The disk is here, Can this be done anytime or does this need to be coordinated?

Wed, Nov 13, 3:57 PM · Discovery-Search (Current work), ops-eqiad, Operations
Cmjohnson moved T146455: Decommission labsdb1002 from Backlog to Decommission on the ops-eqiad board.
Wed, Nov 13, 3:56 PM · hardware-requests, Patch-For-Review, ops-eqiad, Operations
Cmjohnson moved T215332: reimage WMF6937/mw1298 from Backlog to Hardware Failure / Troubleshoot on the ops-eqiad board.
Wed, Nov 13, 3:56 PM · ops-eqiad, Operations
Cmjohnson moved T233071: Decommission db1066.eqiad.wmnet from Backlog to Decommission on the ops-eqiad board.
Wed, Nov 13, 3:55 PM · DC-Ops, ops-eqiad, decommission, Operations
Cmjohnson moved T233578: hw troubleshooting: Memory correctable errors -EDAC- for elastic1029.eqiad.wmnet from Backlog to Hardware Failure / Troubleshoot on the ops-eqiad board.
Wed, Nov 13, 3:55 PM · Operations, ops-eqiad, DC-Ops
Cmjohnson added a comment to T233578: hw troubleshooting: Memory correctable errors -EDAC- for elastic1029.eqiad.wmnet.

@Mathew.onipe elastic1029 is over 2 years out of warranty. The DIMM can be reseated, does this server need scheduled downtime or can it be taken down anytime?

Wed, Nov 13, 3:55 PM · Operations, ops-eqiad, DC-Ops
Cmjohnson moved T235124: Move kafka100[123] to logstash102[012] from Backlog to Hardware Failure / Troubleshoot on the ops-eqiad board.
Wed, Nov 13, 3:53 PM · DC-Ops, Operations, ops-eqiad
Cmjohnson moved T236327: replace onboard NIC in kafka-jumbo100[1-6] from Backlog to Hardware Failure / Troubleshoot on the ops-eqiad board.
Wed, Nov 13, 3:53 PM · ops-eqiad, Operations, Analytics, User-Elukey
Cmjohnson moved T236331: Degraded RAID on cloudvirt1018 from Backlog to Hardware Failure / Troubleshoot on the ops-eqiad board.
Wed, Nov 13, 3:53 PM · ops-eqiad, Operations
Cmjohnson moved T236601: Degraded RAID on elastic1039 from Backlog to Hardware Failure / Troubleshoot on the ops-eqiad board.
Wed, Nov 13, 3:53 PM · Discovery-Search (Current work), ops-eqiad, Operations
Cmjohnson moved T237133: analytics1062 lost one of its power supplies from Backlog to Hardware Failure / Troubleshoot on the ops-eqiad board.
Wed, Nov 13, 3:53 PM · Analytics, Operations, Analytics-Cluster, ops-eqiad
Cmjohnson moved T237438: rack/setup/install ms-be105[7-9].eqiad.wmnet from Cloud Tasks to Racking Tasks on the ops-eqiad board.
Wed, Nov 13, 3:53 PM · Operations, ops-eqiad
Cmjohnson moved T237438: rack/setup/install ms-be105[7-9].eqiad.wmnet from Backlog to Cloud Tasks on the ops-eqiad board.
Wed, Nov 13, 3:52 PM · Operations, ops-eqiad
Cmjohnson moved T237582: frqueue1001 system battery needs replacement from Backlog to Hardware Failure / Troubleshoot on the ops-eqiad board.
Wed, Nov 13, 3:52 PM · ops-eqiad, Operations
Cmjohnson reassigned T228102: rack/setup/install cloudcephmon100[123] from Cmjohnson to Bstorm.

@Bstorm assigning to you to update netbox once the systems are online. I am removing the ops-eqiad tag. If you have an issue please add tag back. Thanks

Wed, Nov 13, 3:52 PM · cloud-services-team (Kanban), Operations, Cloud-Services
Cmjohnson updated the task description for T228102: rack/setup/install cloudcephmon100[123].
Wed, Nov 13, 3:50 PM · cloud-services-team (Kanban), Operations, Cloud-Services
Cmjohnson added a comment to T228102: rack/setup/install cloudcephmon100[123].

The mgmt issue seems to have been resolved, was this done by @Jclark-ctr I do not see an update

Wed, Nov 13, 3:48 PM · cloud-services-team (Kanban), Operations, Cloud-Services

Mon, Nov 11

Cmjohnson added a comment to T237438: rack/setup/install ms-be105[7-9].eqiad.wmnet.

@Jclark-ctr I am not able to login to mgmt, can you verify that the IP, Gateway and subnet are correct.

Mon, Nov 11, 2:18 PM · Operations, ops-eqiad
Cmjohnson updated the task description for T237438: rack/setup/install ms-be105[7-9].eqiad.wmnet.
Mon, Nov 11, 1:41 PM · Operations, ops-eqiad
Cmjohnson moved T234698: ms-be1020 - firmware upgrade: (was: host went down) from Backlog to Blocked on the ops-eqiad board.
Mon, Nov 11, 1:38 PM · ops-eqiad, User-fgiunchedi, SRE-swift-storage, Operations
Cmjohnson reassigned T230746: (Aug 30th, 2019) rack/setup/install elastic10[53-67].eqiad.wmnet from Cmjohnson to Gehel.

@gelhel The new elasticsearch servers are installed and ready for you, I have assigned you the task and removed my project tag. Please reassign and add ops-eqiad tag back if you have any issues.

Mon, Nov 11, 1:23 PM · Discovery-Search (Current work), Patch-For-Review, Operations
Cmjohnson updated the task description for T230746: (Aug 30th, 2019) rack/setup/install elastic10[53-67].eqiad.wmnet.
Mon, Nov 11, 1:21 PM · Discovery-Search (Current work), Patch-For-Review, Operations

Fri, Nov 8

Cmjohnson updated the task description for T230746: (Aug 30th, 2019) rack/setup/install elastic10[53-67].eqiad.wmnet.
Fri, Nov 8, 5:34 PM · Discovery-Search (Current work), Patch-For-Review, Operations
Cmjohnson added a comment to T236601: Degraded RAID on elastic1039.

@Jclark-ctr I have the disk and will leave in data center for you to replace the disk next week.

Fri, Nov 8, 5:30 PM · Discovery-Search (Current work), ops-eqiad, Operations
Cmjohnson closed Unknown Object (Task), a subtask of T236601: Degraded RAID on elastic1039, as Resolved.
Fri, Nov 8, 5:29 PM · Discovery-Search (Current work), ops-eqiad, Operations
Cmjohnson reassigned T234076: (Need by Aug 1) rack/setup/install dumpsdata1003.eqiad.wmnet from Cmjohnson to ArielGlenn.

@ArielGlenn All yours! If you have any issues please add the ops-eqiad tag back. Thanks!

Fri, Nov 8, 3:51 PM · Operations
Cmjohnson updated the task description for T234076: (Need by Aug 1) rack/setup/install dumpsdata1003.eqiad.wmnet.
Fri, Nov 8, 3:48 PM · Operations

Tue, Nov 5

Cmjohnson added a comment to T234076: (Need by Aug 1) rack/setup/install dumpsdata1003.eqiad.wmnet.

Getting this error during initial OS installation

Tue, Nov 5, 11:20 PM · Operations
Cmjohnson updated the task description for T234076: (Need by Aug 1) rack/setup/install dumpsdata1003.eqiad.wmnet.
Tue, Nov 5, 7:21 PM · Operations

Thu, Oct 31

Cmjohnson added a comment to T230746: (Aug 30th, 2019) rack/setup/install elastic10[53-67].eqiad.wmnet.

@Gehel The network switches are setup, all the on-site work has been completed

Thu, Oct 31, 1:40 PM · Discovery-Search (Current work), Patch-For-Review, Operations
Cmjohnson updated the task description for T230746: (Aug 30th, 2019) rack/setup/install elastic10[53-67].eqiad.wmnet.
Thu, Oct 31, 1:39 PM · Discovery-Search (Current work), Patch-For-Review, Operations

Thu, Oct 24

Cmjohnson updated the task description for T227540: b4-eqiad pdu refresh (Thursday 10/24 @11am UTC).
Thu, Oct 24, 12:47 PM · DC-Ops, Operations, ops-eqiad
Cmjohnson moved T234909: decommission auth1001 from Backlog to Decommission on the ops-eqiad board.
Thu, Oct 24, 12:12 PM · ops-eqiad, Operations, DC-Ops, decommission
Cmjohnson moved T233207: Decommission dbproxy1006.eqiad.wmnet from Backlog to Decommission on the ops-eqiad board.
Thu, Oct 24, 12:12 PM · Patch-For-Review, DC-Ops, decommission, ops-eqiad, Operations
Cmjohnson moved T235464: decommission db1070.eqiad.wmnet from Backlog to Decommission on the ops-eqiad board.
Thu, Oct 24, 12:11 PM · Patch-For-Review, DC-Ops, decommission, ops-eqiad, Operations
Cmjohnson moved T236227: decommission dbstore1001.eqiad.wmnet from Backlog to Decommission on the ops-eqiad board.
Thu, Oct 24, 12:11 PM · ops-eqiad, Operations, DC-Ops, decommission
Cmjohnson reassigned T234076: (Need by Aug 1) rack/setup/install dumpsdata1003.eqiad.wmnet from Cmjohnson to ArielGlenn.

@ArielGlenn the onsite work has been completed, I did add the production dns

Thu, Oct 24, 12:09 PM · Operations
Cmjohnson updated the task description for T234076: (Need by Aug 1) rack/setup/install dumpsdata1003.eqiad.wmnet.
Thu, Oct 24, 12:03 PM · Operations
Cmjohnson updated the task description for T234076: (Need by Aug 1) rack/setup/install dumpsdata1003.eqiad.wmnet.
Thu, Oct 24, 11:55 AM · Operations

Tue, Oct 22

Cmjohnson updated the task description for T227142: a6-eqiad pdu refresh (Tuesday 10/22 @11am UTC).
Tue, Oct 22, 7:38 PM · DC-Ops, Operations, ops-eqiad
Cmjohnson added a comment to T235877: db1105 rebooted itself.

Updated all F/W on db1105

  • Raid

-Bios

  • Backplane
  • Idrac
Tue, Oct 22, 12:20 PM · ops-eqiad, DC-Ops, Operations, DBA
Cmjohnson reassigned T228606: Degraded RAID on elastic1046 from Cmjohnson to wiki_willy.
Tue, Oct 22, 12:19 PM · Patch-For-Review, Discovery-Search (Current work), ops-eqiad, Operations
Cmjohnson added a comment to T228606: Degraded RAID on elastic1046.

@wiki_willy can you order a new disk? I tried logging in but being prompted for a password so I cannot get disk info.

Tue, Oct 22, 12:19 PM · Patch-For-Review, Discovery-Search (Current work), ops-eqiad, Operations

Oct 17 2019

Cmjohnson updated the task description for T227133: a8-eqiad pdu refresh (Thursday 10/17 @11am UTC).
Oct 17 2019, 1:22 PM · DC-Ops, Operations, ops-eqiad
Cmjohnson added a comment to T230289: Degraded RAID on cloudvirt1024 -- Filesystem mounted read-only.

Setup raid to raid10 and 2 spare disks.

Oct 17 2019, 11:42 AM · cloud-services-team, ops-eqiad, Operations

Oct 8 2019

Cmjohnson added a comment to T227138: a2-eqiad pdu refresh (Tuesday 10/8 @11am UTC).

the pdu swap is over, we did lose an-worker1079 due to the PSUs not failing over. Everything is cabled and they're linked together. still needs updating.

Oct 8 2019, 5:46 PM · DC-Ops, Operations, ops-eqiad
Cmjohnson updated the task description for T227138: a2-eqiad pdu refresh (Tuesday 10/8 @11am UTC).
Oct 8 2019, 5:45 PM · DC-Ops, Operations, ops-eqiad
Cmjohnson added a comment to T227025: (Need By: August 31) rack/setup/install (3) new zookeeper nodes.

I don't know what you need me to do...the servers were setup correctly.

Oct 8 2019, 5:19 PM · User-Elukey, Operations, ops-eqiad
Cmjohnson added a comment to T232367: (2019-09-15) rack/setup/install ms-be105[1-6].eqiad.wmnet.

@fgiunchedi all the on-site work has been completed...they need production DNS

Oct 8 2019, 3:50 PM · User-fgiunchedi, Operations
Cmjohnson updated the task description for T232367: (2019-09-15) rack/setup/install ms-be105[1-6].eqiad.wmnet.
Oct 8 2019, 3:50 PM · User-fgiunchedi, Operations
Cmjohnson added a comment to T233821: Move YHSM from auth1001 to auth1002.

@MoritzMuehlenhoff It should be working now

Oct 8 2019, 12:11 PM · Operations, ops-eqiad
Cmjohnson updated the task description for T228102: rack/setup/install cloudcephmon100[123].
Oct 8 2019, 11:48 AM · cloud-services-team (Kanban), Operations, Cloud-Services

Oct 4 2019

Cmjohnson added a comment to T228102: rack/setup/install cloudcephmon100[123].

@aborreo I need to know vlan requirements? Same as cephosd? 1 public 1 private?

Oct 4 2019, 7:02 PM · cloud-services-team (Kanban), Operations, Cloud-Services
Cmjohnson added a comment to T224188: rack/setup/install (3) new osd ceph nodes.

The network switch config is done, the main port is on public vlan and the 2nd port is on private

Oct 4 2019, 7:01 PM · Operations, cloud-services-team (Kanban), Cloud-Services
Cmjohnson updated the task description for T224188: rack/setup/install (3) new osd ceph nodes.
Oct 4 2019, 7:00 PM · Operations, cloud-services-team (Kanban), Cloud-Services

Oct 3 2019

Cmjohnson closed T233698: es1019 IPMI and its management interface are unresponsive (again2) as Resolved.

I powered the server off, unplugged everything, removed the PSU drained flea power by holding the power button for 30 secs, plugged everything back in. I am able to access mgmt now

Oct 3 2019, 7:41 PM · ops-eqiad, DBA, Operations
Cmjohnson claimed T233821: Move YHSM from auth1001 to auth1002.

@MoritzMuehlenhoff the HSM has been moved..please confirm you see it

Oct 3 2019, 7:36 PM · Operations, ops-eqiad
Cmjohnson added a comment to T234153: Can't SSH to mw1290.mgmt.

@Dzahn the server needs to be powered off and power removed...can you depool again and leave it depooled for 24 hours please. I will update the task once complete.

Oct 3 2019, 7:31 PM · serviceops, ops-eqiad, Operations
Cmjohnson reassigned T230746: (Aug 30th, 2019) rack/setup/install elastic10[53-67].eqiad.wmnet from Cmjohnson to Jclark-ctr.

I need some clarification on this, please. We do not have 10G space for all of these servers. Especially if you want 9 servers between D2 and D7. There has been a miscommunication in the amount of 10G space we have available. Could someone please clarify whether these need 10G or can they go evenly distributed in 1G racks. Thanks!

Oct 3 2019, 5:37 PM · Discovery-Search (Current work), Patch-For-Review, Operations
Cmjohnson closed T233302: Verify switch port connections as Resolved.

ports have been identified and updated

Oct 3 2019, 12:10 AM · ops-eqiad, Operations

Oct 2 2019

Cmjohnson closed T233642: apply hostname labels for krb1001/WMF5173, a subtask of T233141: setup/install krb1001/WMF5173, as Resolved.
Oct 2 2019, 11:59 PM · Operations, User-Elukey, Analytics
Cmjohnson closed T233642: apply hostname labels for krb1001/WMF5173 as Resolved.

done

Oct 2 2019, 11:59 PM · ops-eqiad, Operations
Cmjohnson added a comment to T234416: asw2-a-eqiad <-> cr2-eqiad fiber issue.

I swapped both optics

Oct 2 2019, 11:56 PM · netops, ops-eqiad, Operations
Cmjohnson closed T229452: db1114 crashed due to memory issues (server under warranty) as Resolved.

@Marostegui yes the board was replaced. Sorry about that I left that to John and the task was not closed.

Oct 2 2019, 11:34 PM · ops-eqiad, DBA, Operations

Oct 1 2019

Cmjohnson updated the task description for T225121: (Need By: Sept 30) upgrade msw1-eqiad from EX4200 to EX4300.
Oct 1 2019, 4:59 PM · netops, ops-eqiad, Operations
Cmjohnson reopened Unknown Object (Task), a subtask of T227314: eqiad+codfw: 6x hardware request for swift backend (each site), as Open.
Oct 1 2019, 4:59 PM · hardware-requests, Operations

Sep 30 2019

Cmjohnson moved T233698: es1019 IPMI and its management interface are unresponsive (again2) from Backlog to Hardware Failure / Troubleshoot on the ops-eqiad board.
Sep 30 2019, 4:47 PM · ops-eqiad, DBA, Operations
Cmjohnson added a comment to T233698: es1019 IPMI and its management interface are unresponsive (again2).

@Marostegui can you please depool this. I will do around 1400UTC on Thursday

Sep 30 2019, 4:47 PM · ops-eqiad, DBA, Operations
Cmjohnson moved T233821: Move YHSM from auth1001 to auth1002 from Backlog to Hardware Failure / Troubleshoot on the ops-eqiad board.
Sep 30 2019, 4:45 PM · Operations, ops-eqiad
Cmjohnson assigned T233821: Move YHSM from auth1001 to auth1002 to Jclark-ctr.

@Jclark-ctr Can you please do this. let me know if you have questions

Sep 30 2019, 4:45 PM · Operations, ops-eqiad
Cmjohnson moved T234009: mw1286.mgmt is down from Backlog to Hardware Failure / Troubleshoot on the ops-eqiad board.
Sep 30 2019, 4:45 PM · serviceops, ops-eqiad, Operations
Cmjohnson assigned T234009: mw1286.mgmt is down to Jclark-ctr.

John, please reseat the green mgmt cable

Sep 30 2019, 4:45 PM · serviceops, ops-eqiad, Operations
Cmjohnson moved T234068: rack/setup/install frban1001.eqiad.wmnet from Backlog to Racking Tasks on the ops-eqiad board.
Sep 30 2019, 4:43 PM · Operations, fundraising-tech-ops, ops-eqiad
Cmjohnson moved T233289: Decommission ms-be1027 from Hardware Failure / Troubleshoot to Decommission on the ops-eqiad board.
Sep 30 2019, 4:43 PM · decommission, Operations, ops-eqiad
Cmjohnson moved T234153: Can't SSH to mw1290.mgmt from Backlog to Hardware Failure / Troubleshoot on the ops-eqiad board.
Sep 30 2019, 4:43 PM · serviceops, ops-eqiad, Operations
Cmjohnson added a comment to T234153: Can't SSH to mw1290.mgmt.

From time to time the mgmt/idrac becomes unresponsive, we will need to power off the host for 10-30secs. Please depool this server and we'll take care of it.

Sep 30 2019, 4:43 PM · serviceops, ops-eqiad, Operations

Sep 27 2019

Cmjohnson added a comment to T229452: db1114 crashed due to memory issues (server under warranty).

@Marostegui the tech couldn’t make it in time yesterday and were scheduled
today 1100-1300 local time.

Sep 27 2019, 10:44 AM · ops-eqiad, DBA, Operations

Sep 26 2019

Cmjohnson updated the task description for T228924: rack/setup/install ganeti10([09]|1[0-8[).eqiad.wmnet.
Sep 26 2019, 6:13 PM · ops-eqiad, vm-requests, Operations
Cmjohnson added a comment to T232367: (2019-09-15) rack/setup/install ms-be105[1-6].eqiad.wmnet.

@fgiunchedi I see you said for raid Partitioning/Raid: "use existing ms-be setup" Unfortunately my memory is not that great anymore can you please remind what the existing raid setup is please,

Sep 26 2019, 5:40 PM · User-fgiunchedi, Operations
Cmjohnson updated the task description for T232367: (2019-09-15) rack/setup/install ms-be105[1-6].eqiad.wmnet.
Sep 26 2019, 5:39 PM · User-fgiunchedi, Operations
Cmjohnson added a comment to T233698: es1019 IPMI and its management interface are unresponsive (again2).

@Marostegui Can you depool it leave it for us to do when we get a free moment. It's an easy thing to do but may not happen until later in the day after your normal day.

Sep 26 2019, 5:16 PM · ops-eqiad, Operations, DBA

Sep 25 2019

Cmjohnson added a comment to T229452: db1114 crashed due to memory issues (server under warranty).

we're on the schedule to get the board swapped for 9/26

Sep 25 2019, 3:28 PM · ops-eqiad, DBA, Operations

Sep 24 2019

Cmjohnson added a comment to T229452: db1114 crashed due to memory issues (server under warranty).

The ticket was created with Dell. I am waiting on their approval and then for the Dell tech to coordinate a day/time to swap the board out

Sep 24 2019, 12:15 PM · ops-eqiad, DBA, Operations

Sep 19 2019

Cmjohnson closed T233265: Check for faulty optic asw-c-eqiad to cr1-eqiad as Resolved.

It's been nearly 24 hours and there are 0 errors. resolving the task

Sep 19 2019, 9:03 PM · Operations, netops, ops-eqiad, DC-Ops
Cmjohnson reassigned T220505: Decommission iron from Cmjohnson to Jclark-ctr.

John, please wipe the servers, remove from the rack, update netbox and the tracking sheet. Assign back to me once you finish so I can kill the switch ports.

Sep 19 2019, 8:58 PM · Cloud-VPS, ops-eqiad, Operations, decommission