Page MenuHomePhabricator

Hourly auth failures are occurring for the openstack user 'traffic-cloud-dns-manager'
Closed, ResolvedPublic

Description

Hourly auth failures are occurring for the openstack user 'traffic-cloud-dns-manager' -- that probably means acme-chief setup is failing as users with that name are usually involved in the call-and-response for certs.

Event Timeline

BCornwall triaged this task as Medium priority.Mar 18 2025, 6:16 PM

it looks like traffic-acmechief01 lost the traffic-cloud-dns-manager credentials at some point:

root@traffic-acmechief01:/etc/acme-chief# cat designate-sync-config.yaml 
---
OS_AUTH_URL: https://openstack.eqiad1.wikimediacloud.org:25000/v3
OS_USERNAME: traffic-cloud-dns-manager
OS_PASSWORD: placeholder
OS_PROJECT_NAMES:
- traffic
OS_REGION_NAME: eqiad1-r

@Andrew what's the recommended way of injecting custom secrets on a puppetserver nowadays?

Vgutierrez claimed this task.

traffic-cloud-dns-manager credentials reset following the instructions available here: https://wikitech.wikimedia.org/wiki/Password_and_2FA_reset#Reset_user_password_in_LDAP

new password has been committed locally on the traffic puppetmaster