Page MenuHomePhabricator

novafullstack errors: DNS timeouts
Closed, ResolvedPublic

Description

Novafullstack is flaky right now, this is one of the errors.

ERROR

Instances are failing sometimes to get a DNS record setup on time.

CURRENT WORKAROUND

Restarting designate-sink on cloudservices1003 seems to work.

SOME NOTES

Designate-sink stops logging anything and stops consuming messages from rabbit, that stops any processing of DNS record
creation, restarting the service gets it unstuck for some time.

Event Timeline

dcaro added a subscriber: Andrew.
dcaro added a subscriber: rook.

This is kind sorted out now by stabilizing the haproxy in front of galera, we are having other issues, will reopen if
it happens again.

dcaro claimed this task.
dcaro moved this task from To refine to Done on the User-dcaro board.