Page MenuHomePhabricator
Create Task
Maniphest T256685

pl_namespace index on pagelinks is unique only in s8
Closed, ResolvedPublic
Actions

Description

Similar to T250060: tl_namespace index on templatelinks is unique only in s8:

    "pagelinks pl_namespace index-uniqueness-mismatch": {
	        "s8": [
	            "db1109.eqiad.wmnet",
	            "db1087.eqiad.wmnet",
	            "db1099.eqiad.wmnet",
	            "db1111.eqiad.wmnet",
	            "db1092.eqiad.wmnet",
	            "db1101.eqiad.wmnet",
	            "db1104.eqiad.wmnet",
	            "db1114.eqiad.wmnet",
	            "db1126.eqiad.wmnet"
	        ]
	    },

ALTER neeed:

ALTER TABLE pagelinks DROP KEY pl_namespace, add KEY `pl_namespace` (`pl_namespace`,`pl_title`,`pl_from`);

Progress

Related Objects
Search...

View Standalone Graph
This task is connected to more than 200 other tasks. Only direct parents and subtasks are shown here. Use View Standalone Graph to show more of the graph.
StatusSubtypeAssignedTask
· · ·
ResolvedLadsgroupT104459 Detect object, schema and data drifts between mediawiki HEAD, production masters and replicas
ResolvedRLazarusT243318 FY2020-2021 Q1 codfw -> eqiad switchback
Resolved• MarosteguiT256685 pl_namespace index on pagelinks is unique only in s8
· · ·

Event Timeline

Ladsgroup created this task.Jun 29 2020, 8:32 PM
Restricted Application removed a project: Patch-For-Review. · View Herald TranscriptJun 29 2020, 8:32 PM
Ladsgroup removed projects: Sustainability (Incident Followup), Datasets-General-or-Unknown, OKR-Work.Jun 29 2020, 8:33 PM
Ladsgroup edited subscribers, added: Kormat; removed: Aklapper, • Springle, Ricordisamoa and 15 others.
• Marostegui triaged this task as Medium priority.Jun 30 2020, 4:43 AM
• Marostegui moved this task from Triage to Backlog on the DBA board.
• Marostegui updated the task description. (Show Details)Jun 30 2020, 5:03 AM
• Marostegui updated the task description. (Show Details)Jun 30 2020, 5:11 AM
• Marostegui claimed this task.EditedJul 14 2020, 1:02 PM
• Marostegui moved this task from Backlog to In progress on the DBA board.

This is how the table looks like after the change on dbstore1005:3318

root@cumin1001:/home/marostegui# mysql.py -hdbstore1005:3318 -e "show create table wikidatawiki.pagelinks\G"
*************************** 1. row ***************************
       Table: pagelinks
Create Table: CREATE TABLE `pagelinks` (
  `pl_from` int(10) unsigned NOT NULL DEFAULT 0,
  `pl_namespace` int(11) NOT NULL DEFAULT 0,
  `pl_title` varbinary(255) NOT NULL DEFAULT '',
  `pl_from_namespace` int(11) NOT NULL DEFAULT 0,
  PRIMARY KEY (`pl_from`,`pl_namespace`,`pl_title`),
  KEY `pl_backlinks_namespace` (`pl_from_namespace`,`pl_namespace`,`pl_title`,`pl_from`),
  KEY `pl_namespace` (`pl_namespace`,`pl_title`,`pl_from`)
) ENGINE=InnoDB DEFAULT CHARSET=binary ROW_FORMAT=COMPRESSED KEY_BLOCK_SIZE=8

Which is exactly how it looks like on enwiki:

root@cumin1001:/home/marostegui# mysql.py -h db1089 -e "show create table enwiki.pagelinks\G"
*************************** 1. row ***************************
       Table: pagelinks
Create Table: CREATE TABLE `pagelinks` (
  `pl_from` int(8) unsigned NOT NULL DEFAULT '0',
  `pl_namespace` int(11) NOT NULL DEFAULT '0',
  `pl_title` varbinary(255) NOT NULL DEFAULT '',
  `pl_from_namespace` int(11) NOT NULL DEFAULT '0',
  PRIMARY KEY (`pl_from`,`pl_namespace`,`pl_title`),
  KEY `pl_namespace` (`pl_namespace`,`pl_title`,`pl_from`),
  KEY `pl_backlinks_namespace` (`pl_from_namespace`,`pl_namespace`,`pl_title`,`pl_from`)
) ENGINE=InnoDB DEFAULT CHARSET=binary ROW_FORMAT=COMPRESSED

This alter takes around 3h, so let's try to get it done before the switchover, so we can take advantage of eqiad being standby and alter the eqiad master without much risks

s8 eqiad progress

  • labsdb1012
  • labsdb1011
  • labsdb1010
  • labsdb1009
  • dbstore1005
  • db1126
  • db1124
  • db1116
  • db1114
  • db1111
  • db1109
  • db1104
  • db1101
  • db1099
  • db1092
  • db1087
• Marostegui added a parent task: T243318: FY2020-2021 Q1 codfw -> eqiad switchback.Jul 15 2020, 5:06 AM
Stashbot added a comment.Jul 15 2020, 9:48 AM

Mentioned in SAL (#wikimedia-operations) [2020-07-15T09:47:59Z] <marostegui> Deploy schema change on s8 codfw master, lag will appear on codfw T256685

• Marostegui updated the task description. (Show Details)Jul 16 2020, 5:05 AM
Stashbot added a comment.Jul 21 2020, 7:48 AM

Mentioned in SAL (#wikimedia-operations) [2020-07-21T07:48:44Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1087 T256685', diff saved to https://phabricator.wikimedia.org/P11978 and previous config saved to /var/cache/conftool/dbconfig/20200721-074843-marostegui.json

Stashbot added a comment.Jul 21 2020, 7:49 AM

Mentioned in SAL (#wikimedia-operations) [2020-07-21T07:49:45Z] <marostegui> Deploy schema change on db1087, lag will appear on s8 (wikidata) on labsdb hosts T256685

• Marostegui changed the task status from Open to Stalled.Jul 22 2020, 8:15 AM
• Marostegui moved this task from In progress to Blocked external/Not db team on the DBA board.

Only the master pending - stalling this until the DC switchover is done and eqiad is stand by.

• Marostegui updated the task description. (Show Details)Jul 24 2020, 10:40 AM
• Marostegui changed the task status from Stalled to Open.Sep 7 2020, 4:43 AM
• Marostegui moved this task from Blocked external/Not db team to In progress on the DBA board.
Stashbot added a comment.Sep 7 2020, 4:53 AM

Mentioned in SAL (#wikimedia-operations) [2020-09-07T04:53:02Z] <marostegui> Deploy schema change on db1109 (eqiad wikidata master) - T256685

• Marostegui added a comment.Sep 7 2020, 8:01 AM

The master is done:

# mysql.py -hdb1109 wikidatawiki -e "show create table pagelinks\G"
*************************** 1. row ***************************
       Table: pagelinks
Create Table: CREATE TABLE `pagelinks` (
  `pl_from` int(10) unsigned NOT NULL DEFAULT '0',
  `pl_namespace` int(11) NOT NULL DEFAULT '0',
  `pl_title` varbinary(255) NOT NULL DEFAULT '',
  `pl_from_namespace` int(11) NOT NULL DEFAULT '0',
  PRIMARY KEY (`pl_from`,`pl_namespace`,`pl_title`),
  KEY `pl_backlinks_namespace` (`pl_from_namespace`,`pl_namespace`,`pl_title`,`pl_from`),
  KEY `pl_namespace` (`pl_namespace`,`pl_title`,`pl_from`)
) ENGINE=InnoDB DEFAULT CHARSET=binary ROW_FORMAT=COMPRESSED KEY_BLOCK_SIZE=8
• Marostegui closed this task as Resolved.Sep 7 2020, 8:02 AM
• Marostegui updated the task description. (Show Details)
Ladsgroup mentioned this in T312538: Collect list of tickets done for fixing core drifts .Jul 7 2022, 12:59 PM
Maintenance_bot moved this task from In progress to Done on the DBA board.Jul 7 2022, 1:30 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL