The puppetserver classes have a configurable notify if central config files of Puppet server are modified. On cloud vps the puppetserver.service gets notified (and thus restarted), but for the production puppet servers an exec is called which generates /run/puppetserver/restart_required along with an informative message like "Restart required from Tue Feb 13 01:52:22 PM UTC 2024". If the file is present, there's also a note added in the /etc/motd

We should add an alert for this (which needs to be applied to all hosts with the puppetserver role).