Page MenuHomePhabricator
Create Task
Maniphest T345732

Turn on write both for beta and production
Closed, ResolvedPublic
Actions

Description

Once T345669: Add support for write both for pagelinks is deployed and T343198: Add pl_target_id column to pagelinks in production is done in that section

Progress:

  • beta
  • s1
  • s2
  • s3
  • s4
  • s5
  • s6
  • s7
  • s8
  • labtestwiki

Details

SubjectRepoBranchLines +/-
Enable pagelinks write both on enwikioperations/mediawiki-configmaster+0 -1
Set pagelinks migration in s4 to write bothoperations/mediawiki-configmaster+0 -2
Set s6 and s8 to write both for pagelinks migrationoperations/mediawiki-configmaster+0 -6
Change default of pagelinks to write bothoperations/mediawiki-configmaster+10 -19
Enable pagelinks migration WRITE BOTH on some more wikisoperations/mediawiki-configmaster+4 -0
Set pagelinks migration stage of cebwiki to write bothoperations/mediawiki-configmaster+1 -0
Turn on write both for pagelinks in largest s3 wikisoperations/mediawiki-configmaster+12 -0
Enable pagelinks write both in testwikioperations/mediawiki-configmaster+1 -0
Pin pagelinks normalization stage to old in productionoperations/mediawiki-configmaster+9 -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

Ladsgroup created this task.Sep 6 2023, 1:11 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 6 2023, 1:11 PM
Ladsgroup triaged this task as Medium priority.Sep 6 2023, 1:13 PM
Ladsgroup edited projects, added DBA; removed Platform Engineering, MediaWiki-Page-derived-data.
Ladsgroup moved this task from Triage to In progress on the DBA board.
Ladsgroup mentioned this in T345733: Run MigrateLinksTable for pagelinks in beta and production .Sep 6 2023, 1:18 PM
gerritbot added a comment.Sep 6 2023, 1:26 PM

Change 955331 had a related patch set uploaded (by Ladsgroup; author: Amir Sarabadani):

[operations/mediawiki-config@master] Pin pagelinks normalization stage to old in production

https://gerrit.wikimedia.org/r/955331

gerritbot added a project: Patch-For-Review.Sep 6 2023, 1:26 PM
gerritbot added a comment.Sep 7 2023, 10:42 AM

Change 955331 merged by jenkins-bot:

[operations/mediawiki-config@master] Pin pagelinks normalization stage to old in production

https://gerrit.wikimedia.org/r/955331

Stashbot added a comment.Sep 7 2023, 10:42 AM

Mentioned in SAL (#wikimedia-operations) [2023-09-07T10:42:51Z] <ladsgroup@deploy1002> Started scap: Backport for [[gerrit:955331|Pin pagelinks normalization stage to old in production (T345732)]]

Stashbot added a comment.Sep 7 2023, 10:44 AM

Mentioned in SAL (#wikimedia-operations) [2023-09-07T10:44:19Z] <ladsgroup@deploy1002> ladsgroup: Backport for [[gerrit:955331|Pin pagelinks normalization stage to old in production (T345732)]] synced to the testservers mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option)

Stashbot added a comment.Sep 7 2023, 10:51 AM

Mentioned in SAL (#wikimedia-operations) [2023-09-07T10:51:56Z] <ladsgroup@deploy1002> Finished scap: Backport for [[gerrit:955331|Pin pagelinks normalization stage to old in production (T345732)]] (duration: 09m 05s)

Ladsgroup updated the task description. (Show Details)Sep 7 2023, 11:08 AM
Maintenance_bot removed a project: Patch-For-Review.Sep 7 2023, 11:10 AM
gerritbot added a comment.Sep 13 2023, 7:32 PM

Change 957339 had a related patch set uploaded (by Ladsgroup; author: Amir Sarabadani):

[operations/mediawiki-config@master] Enable pagelinks write both in testwiki

https://gerrit.wikimedia.org/r/957339

gerritbot added a project: Patch-For-Review.Sep 13 2023, 7:32 PM
Ladsgroup added a comment.Sep 14 2023, 8:55 AM

Largest pagelinks in s3 to prioritize starting the migration script first

 26G ruwikinews/pagelinks.ibd
 21G cewiki/pagelinks.ibd
 17G hiwiki/pagelinks.ibd
 14G mywiki/pagelinks.ibd
 13G bnwiki/pagelinks.ibd
 12G warwiki/pagelinks.ibd
 11G incubatorwiki/pagelinks.ibd
 11G hywiki/pagelinks.ibd
 11G mswiki/pagelinks.ibd
 11G arzwiki/pagelinks.ibd
9.9G ruwiktionary/pagelinks.ibd
gerritbot added a comment.Sep 21 2023, 10:11 AM

Change 957339 merged by jenkins-bot:

[operations/mediawiki-config@master] Enable pagelinks write both in testwiki

https://gerrit.wikimedia.org/r/957339

Stashbot added a comment.Sep 21 2023, 10:12 AM

Mentioned in SAL (#wikimedia-operations) [2023-09-21T10:12:55Z] <ladsgroup@deploy2002> Started scap: Backport for [[gerrit:957339|Enable pagelinks write both in testwiki (T345732)]]

Maintenance_bot removed a project: Patch-For-Review.Sep 21 2023, 10:31 AM
Stashbot added a comment.Sep 21 2023, 10:34 AM

Mentioned in SAL (#wikimedia-operations) [2023-09-21T10:34:51Z] <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:957339|Enable pagelinks write both in testwiki (T345732)]] synced to the testservers mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option)

Stashbot added a comment.Sep 21 2023, 10:49 AM

Mentioned in SAL (#wikimedia-operations) [2023-09-21T10:49:23Z] <ladsgroup@deploy2002> Finished scap: Backport for [[gerrit:957339|Enable pagelinks write both in testwiki (T345732)]] (duration: 36m 27s)

gerritbot added a comment.Sep 21 2023, 11:12 AM

Change 959710 had a related patch set uploaded (by Ladsgroup; author: Amir Sarabadani):

[operations/mediawiki-config@master] Turn on write both for pagelinks in largest s3 wikis

https://gerrit.wikimedia.org/r/959710

gerritbot added a project: Patch-For-Review.Sep 21 2023, 11:12 AM
gerritbot added a comment.Sep 21 2023, 11:19 AM

Change 959710 merged by jenkins-bot:

[operations/mediawiki-config@master] Turn on write both for pagelinks in largest s3 wikis

https://gerrit.wikimedia.org/r/959710

Stashbot added a comment.Sep 21 2023, 11:21 AM

Mentioned in SAL (#wikimedia-operations) [2023-09-21T11:21:00Z] <ladsgroup@deploy2002> Started scap: Backport for [[gerrit:959710|Turn on write both for pagelinks in largest s3 wikis (T345732)]]

Maintenance_bot removed a project: Patch-For-Review.Sep 21 2023, 11:31 AM
Stashbot added a comment.Sep 21 2023, 11:43 AM

Mentioned in SAL (#wikimedia-operations) [2023-09-21T11:43:25Z] <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:959710|Turn on write both for pagelinks in largest s3 wikis (T345732)]] synced to the testservers mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option)

Stashbot added a comment.Sep 21 2023, 11:57 AM

Mentioned in SAL (#wikimedia-operations) [2023-09-21T11:57:45Z] <ladsgroup@deploy2002> Finished scap: Backport for [[gerrit:959710|Turn on write both for pagelinks in largest s3 wikis (T345732)]] (duration: 36m 44s)

gerritbot added a comment.Oct 10 2023, 9:41 AM

Change 964870 had a related patch set uploaded (by Ladsgroup; author: Amir Sarabadani):

[operations/mediawiki-config@master] Set pagelinks migration stage of cebwiki to write both

https://gerrit.wikimedia.org/r/964870

gerritbot added a project: Patch-For-Review.Oct 10 2023, 9:41 AM
gerritbot added a comment.Oct 10 2023, 9:46 AM

Change 964870 merged by jenkins-bot:

[operations/mediawiki-config@master] Set pagelinks migration stage of cebwiki to write both

https://gerrit.wikimedia.org/r/964870

Stashbot added a comment.Oct 10 2023, 9:47 AM

Mentioned in SAL (#wikimedia-operations) [2023-10-10T09:47:21Z] <ladsgroup@deploy2002> Started scap: Backport for [[gerrit:964870|Set pagelinks migration stage of cebwiki to write both (T345732)]]

Stashbot added a comment.Oct 10 2023, 9:48 AM

Mentioned in SAL (#wikimedia-operations) [2023-10-10T09:48:40Z] <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:964870|Set pagelinks migration stage of cebwiki to write both (T345732)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Stashbot added a comment.Oct 10 2023, 9:56 AM

Mentioned in SAL (#wikimedia-operations) [2023-10-10T09:56:32Z] <ladsgroup@deploy2002> Finished scap: Backport for [[gerrit:964870|Set pagelinks migration stage of cebwiki to write both (T345732)]] (duration: 09m 10s)

Maintenance_bot removed a project: Patch-For-Review.Oct 10 2023, 10:11 AM
gerritbot added a comment.Oct 16 2023, 9:36 AM

Change 966140 had a related patch set uploaded (by Ladsgroup; author: Amir Sarabadani):

[operations/mediawiki-config@master] Enable pagelinks migration WRITE BOTH on some s2 wikis

https://gerrit.wikimedia.org/r/966140

gerritbot added a project: Patch-For-Review.Oct 16 2023, 9:36 AM
Ladsgroup updated the task description. (Show Details)Oct 16 2023, 9:37 AM
Ladsgroup updated the task description. (Show Details)
gerritbot added a comment.Oct 16 2023, 9:57 AM

Change 966140 merged by jenkins-bot:

[operations/mediawiki-config@master] Enable pagelinks migration WRITE BOTH on some more wikis

https://gerrit.wikimedia.org/r/966140

Stashbot added a comment.Oct 16 2023, 9:57 AM

Mentioned in SAL (#wikimedia-operations) [2023-10-16T09:57:31Z] <ladsgroup@deploy2002> Started scap: Backport for [[gerrit:966140|Enable pagelinks migration WRITE BOTH on some more wikis (T345732)]]

Stashbot added a comment.Oct 16 2023, 9:58 AM

Mentioned in SAL (#wikimedia-operations) [2023-10-16T09:58:43Z] <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:966140|Enable pagelinks migration WRITE BOTH on some more wikis (T345732)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

gerritbot added a comment.Oct 16 2023, 10:05 AM

Change 966149 had a related patch set uploaded (by Ladsgroup; author: Amir Sarabadani):

[operations/mediawiki-config@master] Change default of pagelinks to write both

https://gerrit.wikimedia.org/r/966149

Stashbot added a comment.Oct 16 2023, 10:06 AM

Mentioned in SAL (#wikimedia-operations) [2023-10-16T10:06:51Z] <ladsgroup@deploy2002> Finished scap: Backport for [[gerrit:966140|Enable pagelinks migration WRITE BOTH on some more wikis (T345732)]] (duration: 09m 19s)

gerritbot added a comment.Oct 16 2023, 10:10 AM

Change 966149 merged by jenkins-bot:

[operations/mediawiki-config@master] Change default of pagelinks to write both

https://gerrit.wikimedia.org/r/966149

Stashbot added a comment.Oct 16 2023, 10:10 AM

Mentioned in SAL (#wikimedia-operations) [2023-10-16T10:10:22Z] <ladsgroup@deploy2002> Started scap: Backport for [[gerrit:966149|Change default of pagelinks to write both (T345732)]]

Maintenance_bot removed a project: Patch-For-Review.Oct 16 2023, 10:11 AM
Stashbot added a comment.Oct 16 2023, 10:11 AM

Mentioned in SAL (#wikimedia-operations) [2023-10-16T10:11:43Z] <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:966149|Change default of pagelinks to write both (T345732)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Ladsgroup updated the task description. (Show Details)Oct 16 2023, 10:13 AM
Stashbot added a comment.Oct 16 2023, 10:18 AM

Mentioned in SAL (#wikimedia-operations) [2023-10-16T10:18:06Z] <ladsgroup@deploy2002> Finished scap: Backport for [[gerrit:966149|Change default of pagelinks to write both (T345732)]] (duration: 07m 44s)

gerritbot added a comment.Oct 17 2023, 6:13 PM

Change 966592 had a related patch set uploaded (by Ladsgroup; author: Amir Sarabadani):

[operations/mediawiki-config@master] Set wikidatawiki to write both for pagelinks migration

https://gerrit.wikimedia.org/r/966592

gerritbot added a project: Patch-For-Review.Oct 17 2023, 6:13 PM
gerritbot added a comment.Oct 18 2023, 10:59 AM

Change 966592 merged by jenkins-bot:

[operations/mediawiki-config@master] Set s6 and s8 to write both for pagelinks migration

https://gerrit.wikimedia.org/r/966592

Stashbot added a comment.Oct 18 2023, 11:00 AM

Mentioned in SAL (#wikimedia-operations) [2023-10-18T11:00:59Z] <ladsgroup@deploy2002> Started scap: Backport for [[gerrit:966592|Set s6 and s8 to write both for pagelinks migration (T345732)]]

Stashbot added a comment.Oct 18 2023, 11:02 AM

Mentioned in SAL (#wikimedia-operations) [2023-10-18T11:02:21Z] <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:966592|Set s6 and s8 to write both for pagelinks migration (T345732)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Ladsgroup updated the task description. (Show Details)Oct 18 2023, 11:08 AM
Maintenance_bot removed a project: Patch-For-Review.Oct 18 2023, 11:10 AM
Stashbot added a comment.Oct 18 2023, 11:11 AM

Mentioned in SAL (#wikimedia-operations) [2023-10-18T11:11:09Z] <ladsgroup@deploy2002> Finished scap: Backport for [[gerrit:966592|Set s6 and s8 to write both for pagelinks migration (T345732)]] (duration: 10m 10s)

Umherirrender mentioned this in T349947: Deadlocks in LinkTargetStore::acquireLinkTargetId since 2023-10-18.Oct 28 2023, 4:00 PM
gerritbot added a comment.Nov 1 2023, 12:01 PM

Change 970745 had a related patch set uploaded (by Ladsgroup; author: Amir Sarabadani):

[operations/mediawiki-config@master] Set pagelinks migration in s4 to write both

https://gerrit.wikimedia.org/r/970745

gerritbot added a project: Patch-For-Review.Nov 1 2023, 12:01 PM
gerritbot added a comment.Nov 1 2023, 12:20 PM

Change 970745 merged by jenkins-bot:

[operations/mediawiki-config@master] Set pagelinks migration in s4 to write both

https://gerrit.wikimedia.org/r/970745

Stashbot added a comment.Nov 1 2023, 12:22 PM

Mentioned in SAL (#wikimedia-operations) [2023-11-01T12:22:06Z] <ladsgroup@deploy2002> Started scap: Backport for [[gerrit:970745|Set pagelinks migration in s4 to write both (T345732)]]

Stashbot added a comment.Nov 1 2023, 12:23 PM

Mentioned in SAL (#wikimedia-operations) [2023-11-01T12:23:30Z] <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:970745|Set pagelinks migration in s4 to write both (T345732)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Ladsgroup updated the task description. (Show Details)Nov 1 2023, 12:28 PM
Maintenance_bot removed a project: Patch-For-Review.Nov 1 2023, 12:30 PM
Stashbot added a comment.Nov 1 2023, 12:31 PM

Mentioned in SAL (#wikimedia-operations) [2023-11-01T12:31:19Z] <ladsgroup@deploy2002> Finished scap: Backport for [[gerrit:970745|Set pagelinks migration in s4 to write both (T345732)]] (duration: 09m 12s)

gerritbot added a comment.Nov 9 2023, 4:37 PM

Change 973200 had a related patch set uploaded (by Ladsgroup; author: Amir Sarabadani):

[operations/mediawiki-config@master] Enable pagelinks write both on enwiki

https://gerrit.wikimedia.org/r/973200

gerritbot added a project: Patch-For-Review.Nov 9 2023, 4:37 PM

Change 973200 merged by jenkins-bot:

[operations/mediawiki-config@master] Enable pagelinks write both on enwiki

https://gerrit.wikimedia.org/r/973200

Stashbot added a comment.Nov 9 2023, 4:40 PM

Mentioned in SAL (#wikimedia-operations) [2023-11-09T16:40:01Z] <ladsgroup@deploy2002> Started scap: Backport for [[gerrit:973200|Enable pagelinks write both on enwiki (T345732)]]

Stashbot added a comment.Nov 9 2023, 4:41 PM

Mentioned in SAL (#wikimedia-operations) [2023-11-09T16:41:26Z] <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:973200|Enable pagelinks write both on enwiki (T345732)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Ladsgroup closed this task as Resolved.Nov 9 2023, 4:46 PM
Ladsgroup updated the task description. (Show Details)
Ladsgroup moved this task from In progress to Done on the DBA board.
Stashbot added a comment.Nov 9 2023, 4:48 PM

Mentioned in SAL (#wikimedia-operations) [2023-11-09T16:48:10Z] <ladsgroup@deploy2002> Finished scap: Backport for [[gerrit:973200|Enable pagelinks write both on enwiki (T345732)]] (duration: 08m 09s)

Maintenance_bot removed a project: Patch-For-Review.Nov 9 2023, 5:11 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL