Page MenuHomePhabricator
Create Task
Maniphest T250062

ipb_parent_block_id_2 index on ipblocks table on s8 only
Closed, ResolvedPublic
Actions

Description

I couldn't find any mention of this index but it exists in s8 only:

    "ipblocks ipb_parent_block_id_2 index-mismatch-prod-extra": {
	        "s8": [
	            "db1109.eqiad.wmnet",
	            "db1101.eqiad.wmnet",
	            "db1126.eqiad.wmnet",
	            "db1111.eqiad.wmnet",
	            "db1099.eqiad.wmnet",
	            "db1087.eqiad.wmnet",
	            "db1092.eqiad.wmnet",
	            "db1104.eqiad.wmnet"
	        ]
	    },

That doesn't seem right.

Progress:

  • Codfw (to be done with replication)

Eqiad:

  • labsdb1012
  • labsdb1011
  • labsdb1010
  • labsdb1009
  • dbstore1005
  • db1126
  • db1124
  • db1116
  • db1111
  • db1109
  • db1104
  • db1101
  • db1099
  • db1092
  • db1087

To run:

alter table ipblocks drop index if exists ipb_parent_block_id_2;

Related Objects
Search...

View Standalone Graph
This task is connected to more than 200 other tasks. Only direct parents and subtasks are shown here. Use View Standalone Graph to show more of the graph.
StatusSubtypeAssignedTask
· · ·
ResolvedLadsgroupT104459 Detect object, schema and data drifts between mediawiki HEAD, production masters and replicas
Resolved• MarosteguiT250062 ipb_parent_block_id_2 index on ipblocks table on s8 only
· · ·

Event Timeline

Ladsgroup created this task.Apr 13 2020, 9:53 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 13 2020, 9:53 AM
• Marostegui added a comment.Apr 13 2020, 10:00 AM

And it does sound as unused:

root@db1109.eqiad.wmnet[sys]> select * from schema_unused_indexes where index_name='ipb_parent_block_id_2';
+---------------+-------------+-----------------------+
| object_schema | object_name | index_name            |
+---------------+-------------+-----------------------+
| wikidatawiki  | ipblocks    | ipb_parent_block_id_2 |
+---------------+-------------+-----------------------+
1 row in set (0.03 sec)
• Marostegui triaged this task as Medium priority.Apr 13 2020, 10:01 AM
• Marostegui moved this task from Triage to Pending comment on the DBA board.
• Marostegui updated the task description. (Show Details)Apr 13 2020, 10:24 AM
• Marostegui added a parent task: T104459: Detect object, schema and data drifts between mediawiki HEAD, production masters and replicas.Apr 13 2020, 11:36 AM
• Marostegui claimed this task.Apr 13 2020, 11:52 AM
• Marostegui moved this task from Pending comment to In progress on the DBA board.

It is unused everywhere:

dbstore1005.eqiad.wmnet:3318
object_schema	object_name	index_name
wikidatawiki	ipblocks	ipb_parent_block_id_2
db1126.eqiad.wmnet:3306
object_schema	object_name	index_name
wikidatawiki	ipblocks	ipb_parent_block_id_2
db1124.eqiad.wmnet:3318
object_schema	object_name	index_name
wikidatawiki	ipblocks	ipb_parent_block_id_2
db1116.eqiad.wmnet:3318
object_schema	object_name	index_name
wikidatawiki	ipblocks	ipb_parent_block_id_2
db1111.eqiad.wmnet:3306
object_schema	object_name	index_name
wikidatawiki	ipblocks	ipb_parent_block_id_2
db1109.eqiad.wmnet:3306
object_schema	object_name	index_name
wikidatawiki	ipblocks	ipb_parent_block_id_2
db1104.eqiad.wmnet:3306
object_schema	object_name	index_name
wikidatawiki	ipblocks	ipb_parent_block_id_2
db1101.eqiad.wmnet:3318
object_schema	object_name	index_name
wikidatawiki	ipblocks	ipb_parent_block_id_2
db1099.eqiad.wmnet:3318
object_schema	object_name	index_name
wikidatawiki	ipblocks	ipb_parent_block_id_2
db1092.eqiad.wmnet:3306
object_schema	object_name	index_name
wikidatawiki	ipblocks	ipb_parent_block_id_2
db1087.eqiad.wmnet:3306
object_schema	object_name	index_name
wikidatawiki	ipblocks	ipb_parent_block_id_2
Stashbot added a comment.Apr 13 2020, 11:53 AM

Mentioned in SAL (#wikimedia-operations) [2020-04-13T11:53:13Z] <marostegui> Deploy schema change on codfw master (lag will appear on codfw) - T250062

• Marostegui updated the task description. (Show Details)Apr 13 2020, 11:54 AM
Stashbot added a comment.Apr 13 2020, 11:57 AM

Mentioned in SAL (#wikimedia-operations) [2020-04-13T11:57:54Z] <marostegui> Deploy schema change on eqiad s8 hosts - T250062

• Marostegui updated the task description. (Show Details)Apr 13 2020, 11:59 AM
• Marostegui closed this task as Resolved.Apr 13 2020, 12:03 PM
• Marostegui updated the task description. (Show Details)

This is all done

root@cumin1001:/home/marostegui# ./section s8 | while read host port; do echo "$host:$port"; mysql.py -h$host:$port wikidatawiki -e "show create table ipblocks\G" | egrep "ipb_parent_block_id_2" ; done
labsdb1012.eqiad.wmnet:3306
labsdb1011.eqiad.wmnet:3306
  KEY `ipb_parent_block_id_2` (`ipb_parent_block_id`),
labsdb1010.eqiad.wmnet:3306
labsdb1009.eqiad.wmnet:3306
dbstore1005.eqiad.wmnet:3318
db2100.codfw.wmnet:3318
db2094.codfw.wmnet:3318
db2086.codfw.wmnet:3318
db2085.codfw.wmnet:3318
db2083.codfw.wmnet:3306
db2082.codfw.wmnet:3306
db2081.codfw.wmnet:3306
db2080.codfw.wmnet:3306
db2079.codfw.wmnet:3306
db1126.eqiad.wmnet:3306
db1124.eqiad.wmnet:3318
db1116.eqiad.wmnet:3318
db1111.eqiad.wmnet:3306
db1109.eqiad.wmnet:3306
db1104.eqiad.wmnet:3306
db1101.eqiad.wmnet:3318
db1099.eqiad.wmnet:3318
db1092.eqiad.wmnet:3306
db1087.eqiad.wmnet:3306

(labsdb1011 is lagging a bit, it will get there through replication)

Ladsgroup mentioned this in T104459: Detect object, schema and data drifts between mediawiki HEAD, production masters and replicas.Apr 13 2020, 12:39 PM
Ladsgroup mentioned this in T312538: Collect list of tickets done for fixing core drifts .Jul 7 2022, 12:59 PM
Maintenance_bot moved this task from In progress to Done on the DBA board.Jul 7 2022, 1:30 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits