Follow the procedure at https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas#Adding_a_wiki
Description
Description
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | Pppery | T390711 Post-creation work for nupwiki | |||
| Resolved | fnegri | T390714 [wikireplicas] Create views for new wiki nupwiki |
Event Timeline
Comment Actions
Mentioned in SAL (#wikimedia-operations) [2025-04-16T10:19:35Z] <fnegri@cumin1002> START - Cookbook sre.wikireplicas.add-wiki for database nupwiki (T390714)
Comment Actions
Mentioned in SAL (#wikimedia-operations) [2025-04-16T10:19:46Z] <fnegri@cumin1002> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database nupwiki (T390714)
Comment Actions
I did run the cookbook too soon: the database for this new wiki hasn't been created yet: T390710: Prepare and check storage layer for nupwiki
Nothing was created by the add-wiki cookbook anyway:
START - Cookbook sre.wikireplicas.add-wiki for database nupwiki (T390714) Generating views... ===== NODE GROUP ===== (1) an-redacteddb1001.eqiad.wmnet ----- OUTPUT ----- 2025-04-16 10:19:45,206 INFO This server doesn't host that database [...]
Comment Actions
@FCeratto-WMF can you confirm if this is good to go?
The grants on 2 clouddb hosts and an-redacteddb were added and the _p database was done too?
Comment Actions
The PII data has been sanitized and the nupwiki_p table has been created on an-redacteddb1001.eqiad.wmnet and has the grant applied. We are not seeing new alerts around PII.
You can go ahead with creating the views.
Comment Actions
Mentioned in SAL (#wikimedia-operations) [2025-04-30T10:15:56Z] <fnegri@cumin1002> START - Cookbook sre.wikireplicas.add-wiki for database nupwiki (T390714)
Comment Actions
Mentioned in SAL (#wikimedia-operations) [2025-04-30T10:16:06Z] <fnegri@cumin1002> END (FAIL) - Cookbook sre.wikireplicas.add-wiki (exit_code=99) for database nupwiki (T390714)
Comment Actions
The cookbook worked fine on an-redacteddb1001, but failed on clouddbs with:
pymysql.err.OperationalError: (1044, "Access denied for user 'maintainviews'@'localhost' to database 'nupwiki\\_p'")
Comment Actions
the nupwiki_p table has been created on an-redacteddb1001.eqiad.wmnet
I think the nupwiki_p database was created only on an-redacteddb1001 and not on clouddb*, @FCeratto-WMF can you create the nupwiki_p database and grants on clouddb* hosts?
Comment Actions
Mentioned in SAL (#wikimedia-operations) [2025-05-06T09:40:06Z] <fnegri@cumin1002> START - Cookbook sre.wikireplicas.add-wiki for database nupwiki (T390714)
Comment Actions
Mentioned in SAL (#wikimedia-operations) [2025-05-06T09:40:17Z] <fnegri@cumin1002> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database nupwiki (T390714)
Comment Actions
It looks like the domain name nupwiki.analytics.db.svc.wikimedia.cloud wasn't created. Was that step missed, or an I doing something wrong?
Comment Actions
@Pppery I was convinced I did run the DNS script a few days before adding the databases, but I must have missed it or it was too soon and it did not work. I'll run it now.
Comment Actions
Done, the DNS records are there now.
2025-05-13T09:18:02Z __main__ INFO : Syncing CNAME records for 111 aliases of 's5' 2025-05-13T09:19:07Z mwopenstackclients.DnsManager WARNING : Creating nupwiki.analytics.db.svc.wikimedia.cloud. [...] 2025-05-13T09:20:50Z mwopenstackclients.DnsManager WARNING : Creating nupwiki.analytics.db.svc.eqiad.wmflabs. [...] 2025-05-13T09:22:30Z mwopenstackclients.DnsManager WARNING : Creating nupwiki.web.db.svc.wikimedia.cloud. [...] 2025-05-13T09:24:13Z mwopenstackclients.DnsManager WARNING : Creating nupwiki.web.db.svc.eqiad.wmflabs.