Mentioned in SAL (#wikimedia-operations) [2025-02-13T11:38:30Z] <fnegri@cumin1002> START - Cookbook sre.wikireplicas.add-wiki for database kncwiki (T385188)

Mentioned in SAL (#wikimedia-operations) [2025-02-13T12:04:31Z] <fnegri@cumin1002> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database kncwiki (T385188)

Views and DNS records were created, but 3 out of 4 DNS records are in status "PENDING" and are not actually working:

fnegri@cloudcontrol1005:~$ sudo wmcs-openstack recordset list e81ea3bb-f8f0-49f4-906b-2d4c2e83cc7e --all-projects |grep kncwiki
| e330bf13-700c-4b24-9978-5d836be5a621 | noauth-project | kncwiki.web.db.svc.eqiad.wmflabs.                   | CNAME | s5.web.db.svc.wikimedia.cloud.                                                            | PENDING | CREATE |
fnegri@cloudcontrol1005:~$ sudo wmcs-openstack recordset list 04c45c1f-214d-450b-a733-028dcdc87a12 --all-projects |grep kncwiki
| cbb927cd-bf67-441b-84a2-14a8830fb4e9 | noauth-project | kncwiki.analytics.db.svc.eqiad.wmflabs.                   | CNAME | s5.analytics.db.svc.wikimedia.cloud.                                                      | PENDING | CREATE |
fnegri@cloudcontrol1005:~$ sudo wmcs-openstack recordset list 55dc12de-d948-4c52-9ebb-f90705b10864 --all-projects |grep kncwiki
| 7cc18a7f-944c-4ad1-aac5-8b7edcc9a412 | cloudinfra | kncwiki.web.db.svc.wikimedia.cloud.                   | CNAME | s5.web.db.svc.wikimedia.cloud.                                                            | ACTIVE | NONE   |
fnegri@cloudcontrol1005:~$ sudo wmcs-openstack recordset list 524eb3a1-fa1a-42a8-a166-47f419bfb107 --all-projects |grep kncwiki
| 5bf0b201-5b8d-4741-b797-a0bb00d0efc9 | cloudinfra | kncwiki.analytics.db.svc.wikimedia.cloud.                   | CNAME | s5.analytics.db.svc.wikimedia.cloud.                                                      | PENDING | CREATE |

@Andrew any idea what's the issue?

It seems like the zone serial isn't incrementing properly after a new recordset is added. I'm giving a poke with

update zones set serial='1734613004' where name='analytics.db.svc.wikimedia.cloud.'  \G

I restarted designate services and this has resolved. I don't have much of a theory beyond that.

Thanks @Andrew, this task is now complete.

[wikireplicas] Create views for new wiki kncwikiClosed, ResolvedPublicActions

Description

Related ObjectsSearch...

Event Timeline

[wikireplicas] Create views for new wiki kncwiki
Closed, ResolvedPublic
Actions

Related Objects
Search...