Page MenuHomePhabricator
Create Task
Maniphest T437208

Update user-facing Wiki Replicas features and documentation for x4
Closed, ResolvedPublic
Actions

Details

Related Changes in Gerrit:
SubjectAuthorRepoBranchLines +/-
hieradata: cloudlb: Remove temporary x4 section_port overrideMajavahoperations/puppetproduction+0 -9
openstack: wikireplica_dns: Add user-facing names for x4 databasesMajavahoperations/puppetproduction+8 -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

• taavi created this task.Sep 7 2026, 10:16 AM
Restricted Application added a project: tools-platform-team. · View Herald TranscriptSep 7 2026, 10:16 AM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
• taavi added subtasks: T409560: Add support for x1 and x4 sections on wiki replicas on the load balancer layer, T431309: Setup x4 on sanitarium hosts.Sep 7 2026, 10:17 AM
• taavi added a parent task: T404715: Setup x4 section.
gerritbot added a comment.Sep 7 2026, 10:18 AM

Change #1337552 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] openstack: wikireplica_dns: Add user-facing names for x4 databases

https://gerrit.wikimedia.org/r/1337552

gerritbot added a project: Patch-For-Review.Sep 7 2026, 10:18 AM
gerritbot added a comment.Sep 7 2026, 10:31 AM

Change #1337552 merged by Majavah:

[operations/puppet@production] openstack: wikireplica_dns: Add user-facing names for x4 databases

https://gerrit.wikimedia.org/r/1337552

• taavi added a comment.Sep 7 2026, 10:36 AM
2026-09-07T10:35:40Z __main__     INFO    : Syncing additional CNAME: 'links.commonswiki.analytics.db.svc.wikimedia.cloud.'
2026-09-07T10:35:42Z mwopenstackclients.DnsManager WARNING : Creating links.commonswiki.analytics.db.svc.wikimedia.cloud.
2026-09-07T10:35:42Z __main__     INFO    : Syncing additional CNAME: 'links.testcommonswiki.analytics.db.svc.wikimedia.cloud.'
2026-09-07T10:35:44Z mwopenstackclients.DnsManager WARNING : Creating links.testcommonswiki.analytics.db.svc.wikimedia.cloud.
2026-09-07T10:36:14Z __main__     INFO    : Syncing additional CNAME: 'links.commonswiki.web.db.svc.wikimedia.cloud.'
2026-09-07T10:36:16Z mwopenstackclients.DnsManager WARNING : Creating links.commonswiki.web.db.svc.wikimedia.cloud.
2026-09-07T10:36:16Z __main__     INFO    : Syncing additional CNAME: 'links.testcommonswiki.web.db.svc.wikimedia.cloud.'
2026-09-07T10:36:18Z mwopenstackclients.DnsManager WARNING : Creating links.testcommonswiki.web.db.svc.wikimedia.cloud.
CodeReviewBot added a comment.Sep 7 2026, 10:54 AM

taavi opened https://gitlab.wikimedia.org/repos/cloud/toolforge/misctools-cli/-/merge_requests/23

sql: Add support for links cluster

Stashbot added a comment.Sep 7 2026, 11:07 AM

Mentioned in SAL (#wikimedia-cloud) [2026-09-07T11:07:21Z] <taavi> add x4 to list of sections T437208

CodeReviewBot added a comment.Sep 7 2026, 1:54 PM

taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/misctools-cli/-/merge_requests/23

sql: Add support for links cluster

Maintenance_bot removed a project: Patch-For-Review.Sep 7 2026, 2:32 PM
• taavi added a project: User-notice.Sep 7 2026, 3:48 PM

This should go in Tech News as well. This was announced as https://lists.wikimedia.org/hyperkitty/list/cloud-announce@lists.wikimedia.org/thread/E4RXH3F3WTBWSGZDN6BZPJGEUY2IM4KP/, this mechanism is documented at https://wikitech.wikimedia.org/wiki/Help:Wiki_Replicas#Extension_databases and T390954#10784617 has the wording used last time.

• taavi added a comment.Sep 7 2026, 3:53 PM

Added x4 extension aliases to the documentation as https://wikitech.wikimedia.org/w/index.php?title=Help:Wiki_Replicas&diff=prev&oldid=2455090. Whether testcommonswiki will actually end up on x4 or not is still a tiny question mark, but my understanding from IRC is that it is headed there eventually.

fnegri subscribed.Sep 7 2026, 4:55 PM
• taavi added a comment.Sep 7 2026, 6:56 PM

Created https://wikitech.wikimedia.org/wiki/News/2026_Commons_links_tables_database_split to collect the instructions in an editable place similar to last time's News page.

Marostegui mentioned this in T404715: Setup x4 section.Sep 8 2026, 9:51 AM
• taavi closed subtask T409560: Add support for x1 and x4 sections on wiki replicas on the load balancer layer as Resolved.Sep 8 2026, 10:56 AM
Zabe subscribed.Sep 8 2026, 1:12 PM
BrandonXLF subscribed.Sep 9 2026, 2:22 AM
STei-WMF subscribed.Wed, Sep 9, 5:12 PM

@taavi

This is how I have interpreted your instruction as an entry:

"Developers who maintain a tool that queries the Wikimedia Commons links tables need to update their code to connect to the new x4 database cluster. The links tables have been moved from the s4 cluster to x4, and will no longer receive updates on s4. The page and redirect tables remain available on both clusters. A wiki replica for the x4 cluster will be set up afterwards."

The missing detail here I need you to confirm is why this change is being made.

In T437208#12295345, @taavi wrote:

This should go in Tech News as well. This was announced as https://lists.wikimedia.org/hyperkitty/list/cloud-announce@lists.wikimedia.org/thread/E4RXH3F3WTBWSGZDN6BZPJGEUY2IM4KP/, this mechanism is documented at https://wikitech.wikimedia.org/wiki/Help:Wiki_Replicas#Extension_databases and T390954#10784617 has the wording used last time.

STei-WMF moved this task from To Triage to Announce in next Tech/News on the User-notice board.Wed, Sep 9, 5:13 PM
gerritbot added a comment.Thu, Sep 10, 2:36 PM

Change #1338949 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] hieradata: cloudlb: Remove temporary x4 section_port override

https://gerrit.wikimedia.org/r/1338949

gerritbot added a project: Patch-For-Review.Thu, Sep 10, 2:36 PM
• taavi added a comment.Fri, Sep 11, 11:12 AM

Hi, thanks!

In T437208#12304453, @STei-WMF wrote:

This is how I have interpreted your instruction as an entry:

"Developers who maintain a tool that queries the Wikimedia Commons links tables need to update their code to connect to the new x4 database cluster. The links tables have been moved from the s4 cluster to x4, and will no longer receive updates on s4. The page and redirect tables remain available on both clusters. A wiki replica for the x4 cluster will be set up afterwards."

The missing detail here I need you to confirm is why this change is being made.

Thank you! The change is happening because the s4 cluster has grown to be too large to function efficiently. Can we also have the entry link to https://wikitech.wikimedia.org/wiki/News/2026_Commons_links_tables_database_split?

STei-WMF added a comment.EditedFri, Sep 11, 4:04 PM

@taavi, done: https://meta.wikimedia.org/wiki/Tech/News/2026/38

AntiCompositeNumber subscribed.Sun, Sep 13, 1:27 AM
JeanFred subscribed.Mon, Sep 14, 7:53 AM
• taavi renamed this task from Update Wiki Replicas documentation for x4 rollout to Update user-facing Wiki Replicas features and documentation for x4.Mon, Sep 14, 8:08 AM
gerritbot added a comment.Mon, Sep 14, 8:34 AM

Change #1338949 merged by Majavah:

[operations/puppet@production] hieradata: cloudlb: Remove temporary x4 section_port override

https://gerrit.wikimedia.org/r/1338949

Maintenance_bot removed a project: Patch-For-Review.Mon, Sep 14, 9:31 AM
Marostegui closed subtask T431309: Setup x4 on sanitarium hosts as Resolved.Tue, Sep 15, 8:41 AM
• taavi closed this task as Resolved.Tue, Sep 15, 11:28 AM
• taavi claimed this task.
STei-WMF moved this task from Announce in next Tech/News to Already announced/Archive on the User-notice board.Thu, Sep 17, 1:57 PM
Maintenance_bot edited projects, added: User-notice-archive; removed: User-notice.Sun, Sep 27, 2:31 PM
aputhin moved this task from Backlog to Done on the tools-platform-team board.Fri, Oct 2, 12:50 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits