Page MenuHomePhabricator

Document/script ORES config change deployment process
Closed, ResolvedPublic

Description

We should have a single script that we use locally for controlled restarts. The script should wait until one node is warmed up before restarting the next node (or something like that).

Document how to do this on wikitech.

Event Timeline

I made some minor changes here: https://wikitech.wikimedia.org/wiki/ORES/Deployment#Puppet-managed_config_changes

Should we have a common script that we use to restart the servers? It seems like scap should be able to handle this for us and implement a canary node.

Scap has restart service option but that works only for uwsgi, At the end by moving to kubernetes none of this matters anymore.

Halfak moved this task from Review to Completed on the Machine-Learning-Team (Active Tasks) board.

Good enough for me then. Thanks for taking a look at scap.