Page MenuHomePhabricator

Use multiple puppetdbs on puppet masters
Closed, ResolvedPublic

Description

Yesterday puppetdb (nitrogen) was unavailable due to ganeti outage (https://wikitech.wikimedia.org/wiki/Incident_documentation/20170629-ganeti) and that failure was impacting puppet runs across the fleet. It looks like recent versions of the puppetdb terminus support multiple server_uris and are capable of failing over among them: https://docs.puppet.com/puppetdb/latest/puppetdb_connection.html#main-settings

Related Objects

StatusSubtypeAssignedTask
OpenNone
ResolvedLSobanski

Event Timeline

jbond subscribed.

Im curious how puppetdb failed? do you rember? As the postgress write master is always on the primary puppetdb server im not sure we would get much of a win here. unless we also spun up a seperate postgress database

LSobanski claimed this task.
LSobanski subscribed.

The original bug is no longer applicable a separate task will be created for reviewing the availability plan for Puppet DB.