Page MenuHomePhabricator

Puppet errors on automation-framework project
Closed, DuplicatePublic

Description

Puppet has been failing on these servers:

  • af-debmonitor.automation-framework.eqiad.wmflabs
  • af-puppetdb01.automation-framework.eqiad.wmflabs
  • af-puppetdb02.automation-framework.eqiad.wmflabs
  • af-puppetmaster02.automation-framework.eqiad.wmflabs

If these are one-off test servers, please let us know so we can delete them.

Otherwise, could you take a few minutes to fix that? Thank you!

Event Timeline

GTirloni created this task.

@GTirloni yeah, sorry for the trouble, I know about them, just didn't had the time yet to fix them as the local PuppetDB is broken (I think it happened during the migration to the new region).
I will not spend time to fix the immediate PuppetDB failure as it's an old one anyway and we're in the process to upgrade the local PuppetDB used by the local Puppet master to the same version of production in the next few days.
If this is a blocker for anything please let me know so that I can point those instances temporarily to the Cloud puppetmasters and then back to the local one once we have the new PuppetDB up and running.

P.S. I've removed a bunch of people from subscribers as they are not involved with those instances.

@Volans no worries and thanks for the context. This is more of a heads up than anything, thanks!

Btw, I added all project owners as subscribers. If you want to review the list of project owners, just let me know and I can change that: https://tools.wmflabs.org/openstack-browser/project/automation-framework

Hello this is my fault due to inexperience administrating puppet and it being sort of a back-burner project for me. If it blocks anyone, let us know. It should be resolved this week.

crusnov lowered the priority of this task from High to Medium.