We need to do an Elasticsearch restart to unblock plugin upgrades, among a few other things. Restarts have been/are currently being blocked by the fact that the prometheus query which verifies all relevant write queues are empty is out of date and thus failing the restart.
There's also some java8 security updates that have been rolled out and require a full reboot take effect.
- Spicerack & cookbooks repo updated to unblock restarts by fixing the broken prometheus query
- Full reboot performed on all relevant elasticsearch nodes (relforge, cloudforge, eqiad, codfw)
We'll deploy in order of ascending criticality, giving us this:
We'll want to use relforge to verify that the new java version doesn't give any problems before proceeding.
Done with all restarts