This is a service implementation tracking task, created at the request of #serviceops, and tied to the racking task for arclamp1001.eqiad.wmnet.e following steps are needed to replace webperf1004 with the new arclamp1001 hardware:
Once related racking task T319433 is resolv[] add rsync config (rsync::quickdatacopy) to allow syncing data from webperf1004 to arclamp1001
[] do the initial rsync and validate filesystem permissions
Coordianate a one hour window with Performance team for the actual migration:
[] disable Puppet on webperf1004
[] mask the excimer-k8s-log.service, excimer-k8s-wall-log.service, excimer-log.service, excimer-wall-log.service services on webperf1004 (that's why we need to disable puppet, otherwise it would unmask them)
[] we also need to mask some timers used for the sync: arclamp_generate_metrics.timer, arclamp_compress_logs.timer, arclamp_generate_svgs.timer
[] rsync again to catch up with the latest changes
[] apply the webperf::profiling_tools role to arclamp1001
[] Change arclamp_host in Hiera to point to arclamp1001
[] Extend scap/dsh config to also deploy to arclamp1001
[] puppet needs to remain disabled on webperf1004 before it's decommed, this host is ready for serviceops to take over.so best to set downtime for a week