Two tools that would be super useful:
- puppet-compiler, which would allow us to see a diff of changes (for both toolsbeta and tools) before applying. See https://wikitech.wikimedia.org/wiki/Nova_Resource:Puppet3-diffs for the prod setup / https://github.com/wikimedia/operations-puppet/tree/f1002d7ca88b13966cd138fe079f47c4b13b4559/modules/puppet_compiler (although that doesn't seem applied to the actual puppet compiler host)
- A tool that actually deploys the change on toolsbeta (but not tools). This means an apply-manual test-reset-cycle would be useful. Effectively, this means:
- apply a change from gerrit to /var/lib/git/operations/puppet on puppetmaster-beta
- runs puppet on all hosts to actually pull in the changes
- tell the user to test
- checkout origin/production in /var/lib/git/operations/puppet
- runs puppet on all hosts to actually pull in the clean state