I added a patch to allow Jenkins slaves to trust the gerrit host here - https://github.com/wikimedia/operations-puppet/blob/production/modules/role/manifests/ci/slave/labs.pp#L66. The ssh key should be updated if it changes when the Gerrit server is upgraded to Jessie.
Creating this task so we remember to do it.