All the remote setup has been completed, installation to continue on T228099.
All remote hands setup on T229243 are done.
Thu, Sep 19
Ready for disk wipes and continued decom process.
Just FYI it seems the serial console's have some built in nagios support. I've attached a print out of the nagios configuration screen below.
ready for disk wipe and unracking
Wed, Sep 18
Tue, Sep 17
It seems that when the new PDU goes into place, it fails the icinga checks for:
Please note this is an issue that is happening on ALL the new PDUs. I'll update the parent task.
15:15 <@RobH> : So, I can confirm in librenms it sees both towers
15:15 <@RobH> : so, this seems to me to be an icinga issue
15:15 <@RobH> : Does this seem reasonable? If so, we need to likely involve someone with some icinga knowledge.
T233142 created for setup, resolving this request task!
T233141 created for setup. resolving this request task!
I've gone ahead and setup remote access and settings identical to the other new PDUs. It now is online/ping/ssh/syslog accessible.
If that is the case, then no puppet updates are required, as sentry4 is already listed for all the PDU models in eqiad.
Thu, Sep 12
Wed, Sep 11
Mon, Sep 9
I've set the due date via the require by date on the ordering task:
Fri, Sep 6
Thu, Sep 5
I went ahead and pulled the CyrusOne report for this month, and humidity seems to be in the 50% range. It started high, but seems CyrusOne rebalanced and now its back to normal.
Wed, Sep 4
Fri, Aug 30
Thu, Aug 29
Also, in the future, please open a new task for hardware troubleshooting and follow all directions on:
This hsows no errors in the service event log for the memory:
Wed, Aug 28
Removing myself as assignee since this has all the servers populated in the task description.
Fri, Aug 23
I cannot locate the labeled switch port on the switch, so @Papaul will need to trace and disable this via on-site work.
statsd.codfw.wmnet points to graphite2001.codfw.wmnet, so I'm not sure what to point this at.
Ok, I synced with @wiki_willy about this and the comment above.