Page MenuHomePhabricator
Create Task
Maniphest T300402

Add namespace column to Linter table
Closed, ResolvedPublic
Actions

Description

Adding the namespace ID and an index between category and namespace will dramatically reduce the amount of time the database spends when processing a Linter category report when namespace is also specified.

  1. ALTERs to run: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Linter/+/755817/12/sql/patch-linter-add-namespace.sql
  2. Where to run those changes: all.dblist
  3. When to run those changes: At any time
  4. If the schema change is backwards compatible: Yes
  5. If the schema change has been tested already on some of the test/beta wikis: Tested in beta
  6. if the data should be made available on the labs replicas and/or dumps: Table is public

Progress:

  • s1
  • s2
  • s3
  • s4
  • s5
  • s6
  • s7
  • s8
  • labtestwiki

Details

SubjectRepoBranchLines +/-
add_linter_namespace_T300402.py: stop&start slaveoperations/software/schema-changesmaster+1 -1
add_linter_namespace_T300402.py: New schema changeoperations/software/schema-changesmaster+37 -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Stashbot added a comment.Feb 8 2022, 9:54 AM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T09:54:20Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1112 (T300402)', diff saved to https://phabricator.wikimedia.org/P20256 and previous config saved to /var/cache/conftool/dbconfig/20220208-095420-marostegui.json

Stashbot added a comment.Feb 8 2022, 9:54 AM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T09:54:30Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1166 (T300402)', diff saved to https://phabricator.wikimedia.org/P20257 and previous config saved to /var/cache/conftool/dbconfig/20220208-095427-marostegui.json

Stashbot added a comment.Feb 8 2022, 10:16 AM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T10:16:33Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1166 (T300402)', diff saved to https://phabricator.wikimedia.org/P20264 and previous config saved to /var/cache/conftool/dbconfig/20220208-101631-marostegui.json

Stashbot added a comment.Feb 8 2022, 11:01 AM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T11:01:47Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1166 (T300402)', diff saved to https://phabricator.wikimedia.org/P20275 and previous config saved to /var/cache/conftool/dbconfig/20220208-110147-marostegui.json

Stashbot added a comment.Feb 8 2022, 11:01 AM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T11:01:56Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1179 (T300402)', diff saved to https://phabricator.wikimedia.org/P20276 and previous config saved to /var/cache/conftool/dbconfig/20220208-110154-marostegui.json

Stashbot added a comment.Feb 8 2022, 11:20 AM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T11:20:42Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1179 (T300402)', diff saved to https://phabricator.wikimedia.org/P20279 and previous config saved to /var/cache/conftool/dbconfig/20220208-112042-marostegui.json

Stashbot added a comment.Feb 8 2022, 12:05 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T12:05:57Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1179 (T300402)', diff saved to https://phabricator.wikimedia.org/P20292 and previous config saved to /var/cache/conftool/dbconfig/20220208-120556-marostegui.json

Stashbot added a comment.Feb 8 2022, 12:06 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T12:06:06Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1175 (T300402)', diff saved to https://phabricator.wikimedia.org/P20293 and previous config saved to /var/cache/conftool/dbconfig/20220208-120603-marostegui.json

Stashbot added a comment.Feb 8 2022, 12:55 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T12:55:08Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1175 (T300402)', diff saved to https://phabricator.wikimedia.org/P20301 and previous config saved to /var/cache/conftool/dbconfig/20220208-125508-marostegui.json

Marostegui added a comment.Feb 8 2022, 12:58 PM

s3 is done

Marostegui updated the task description. (Show Details)Feb 8 2022, 12:58 PM
Stashbot added a comment.Feb 8 2022, 1:40 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T13:40:22Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1175 (T300402)', diff saved to https://phabricator.wikimedia.org/P20314 and previous config saved to /var/cache/conftool/dbconfig/20220208-134022-marostegui.json

Marostegui added a comment.Feb 8 2022, 1:40 PM

Deploying on s1

Stashbot added a comment.Feb 8 2022, 1:43 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T13:43:25Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1169 (T300402)', diff saved to https://phabricator.wikimedia.org/P20316 and previous config saved to /var/cache/conftool/dbconfig/20220208-134324-marostegui.json

Stashbot added a comment.Feb 8 2022, 1:47 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T13:47:48Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1169 (T300402)', diff saved to https://phabricator.wikimedia.org/P20317 and previous config saved to /var/cache/conftool/dbconfig/20220208-134748-marostegui.json

Stashbot added a comment.Feb 8 2022, 2:33 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T14:33:02Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1169 (T300402)', diff saved to https://phabricator.wikimedia.org/P20326 and previous config saved to /var/cache/conftool/dbconfig/20220208-143302-marostegui.json

Stashbot added a comment.Feb 8 2022, 2:35 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T14:35:46Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1163 (T300402)', diff saved to https://phabricator.wikimedia.org/P20327 and previous config saved to /var/cache/conftool/dbconfig/20220208-143545-marostegui.json

Stashbot added a comment.Feb 8 2022, 2:40 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T14:40:12Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1163 (T300402)', diff saved to https://phabricator.wikimedia.org/P20328 and previous config saved to /var/cache/conftool/dbconfig/20220208-144011-marostegui.json

Stashbot added a comment.Feb 8 2022, 3:25 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T15:25:26Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1163 (T300402)', diff saved to https://phabricator.wikimedia.org/P20336 and previous config saved to /var/cache/conftool/dbconfig/20220208-152525-marostegui.json

Stashbot added a comment.Feb 8 2022, 3:28 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T15:28:12Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1134 (T300402)', diff saved to https://phabricator.wikimedia.org/P20338 and previous config saved to /var/cache/conftool/dbconfig/20220208-152812-marostegui.json

Stashbot added a comment.Feb 8 2022, 3:32 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T15:32:51Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1134 (T300402)', diff saved to https://phabricator.wikimedia.org/P20339 and previous config saved to /var/cache/conftool/dbconfig/20220208-153251-marostegui.json

Stashbot added a comment.Feb 8 2022, 4:18 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T16:18:05Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1134 (T300402)', diff saved to https://phabricator.wikimedia.org/P20345 and previous config saved to /var/cache/conftool/dbconfig/20220208-161805-marostegui.json

Stashbot added a comment.Feb 8 2022, 4:18 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T16:18:15Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1135 (T300402)', diff saved to https://phabricator.wikimedia.org/P20346 and previous config saved to /var/cache/conftool/dbconfig/20220208-161812-marostegui.json

Stashbot added a comment.Feb 8 2022, 4:22 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T16:22:51Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1135 (T300402)', diff saved to https://phabricator.wikimedia.org/P20347 and previous config saved to /var/cache/conftool/dbconfig/20220208-162250-marostegui.json

Stashbot added a comment.Feb 8 2022, 5:08 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T17:08:05Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1135 (T300402)', diff saved to https://phabricator.wikimedia.org/P20356 and previous config saved to /var/cache/conftool/dbconfig/20220208-170805-marostegui.json

Stashbot added a comment.Feb 8 2022, 5:08 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T17:08:15Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1099:3311 (T300402)', diff saved to https://phabricator.wikimedia.org/P20357 and previous config saved to /var/cache/conftool/dbconfig/20220208-170812-marostegui.json

Stashbot added a comment.Feb 8 2022, 5:13 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T17:13:23Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1099:3311 (T300402)', diff saved to https://phabricator.wikimedia.org/P20358 and previous config saved to /var/cache/conftool/dbconfig/20220208-171323-marostegui.json

Stashbot added a comment.Feb 8 2022, 5:58 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T17:58:37Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1099:3311 (T300402)', diff saved to https://phabricator.wikimedia.org/P20366 and previous config saved to /var/cache/conftool/dbconfig/20220208-175837-marostegui.json

Stashbot added a comment.Feb 8 2022, 5:58 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T17:58:48Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1184 (T300402)', diff saved to https://phabricator.wikimedia.org/P20367 and previous config saved to /var/cache/conftool/dbconfig/20220208-175844-marostegui.json

Stashbot added a comment.Feb 8 2022, 6:03 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T18:03:18Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1184 (T300402)', diff saved to https://phabricator.wikimedia.org/P20368 and previous config saved to /var/cache/conftool/dbconfig/20220208-180316-marostegui.json

Stashbot added a comment.Feb 8 2022, 6:48 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T18:48:33Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1184 (T300402)', diff saved to https://phabricator.wikimedia.org/P20374 and previous config saved to /var/cache/conftool/dbconfig/20220208-184832-marostegui.json

Stashbot added a comment.Feb 8 2022, 6:54 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T18:54:20Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1106 (T300402)', diff saved to https://phabricator.wikimedia.org/P20376 and previous config saved to /var/cache/conftool/dbconfig/20220208-185420-marostegui.json

Stashbot added a comment.Feb 8 2022, 7:00 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T19:00:07Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1106 (T300402)', diff saved to https://phabricator.wikimedia.org/P20377 and previous config saved to /var/cache/conftool/dbconfig/20220208-190006-marostegui.json

Stashbot added a comment.Feb 8 2022, 7:45 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T19:45:21Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1106 (T300402)', diff saved to https://phabricator.wikimedia.org/P20383 and previous config saved to /var/cache/conftool/dbconfig/20220208-194520-marostegui.json

Stashbot added a comment.Feb 8 2022, 7:45 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T19:45:30Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1119 (T300402)', diff saved to https://phabricator.wikimedia.org/P20384 and previous config saved to /var/cache/conftool/dbconfig/20220208-194528-marostegui.json

Stashbot added a comment.Feb 8 2022, 7:50 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T19:50:07Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1119 (T300402)', diff saved to https://phabricator.wikimedia.org/P20385 and previous config saved to /var/cache/conftool/dbconfig/20220208-195007-marostegui.json

Stashbot added a comment.Feb 8 2022, 8:35 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T20:35:22Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1119 (T300402)', diff saved to https://phabricator.wikimedia.org/P20391 and previous config saved to /var/cache/conftool/dbconfig/20220208-203521-marostegui.json

Stashbot added a comment.Feb 8 2022, 8:35 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T20:35:33Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1105:3311 (T300402)', diff saved to https://phabricator.wikimedia.org/P20392 and previous config saved to /var/cache/conftool/dbconfig/20220208-203529-marostegui.json

Stashbot added a comment.Feb 8 2022, 8:40 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T20:40:37Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1105:3311 (T300402)', diff saved to https://phabricator.wikimedia.org/P20394 and previous config saved to /var/cache/conftool/dbconfig/20220208-204036-marostegui.json

Stashbot added a comment.Feb 8 2022, 9:25 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T21:25:51Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1105:3311 (T300402)', diff saved to https://phabricator.wikimedia.org/P20397 and previous config saved to /var/cache/conftool/dbconfig/20220208-212550-marostegui.json

Stashbot added a comment.Feb 8 2022, 9:26 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T21:26:02Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1164 (T300402)', diff saved to https://phabricator.wikimedia.org/P20398 and previous config saved to /var/cache/conftool/dbconfig/20220208-212558-marostegui.json

Stashbot added a comment.Feb 8 2022, 9:30 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T21:30:32Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1164 (T300402)', diff saved to https://phabricator.wikimedia.org/P20399 and previous config saved to /var/cache/conftool/dbconfig/20220208-213031-marostegui.json

Stashbot added a comment.Feb 8 2022, 10:15 PM

Mentioned in SAL (#wikimedia-operations) [2022-02-08T22:15:46Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1164 (T300402)', diff saved to https://phabricator.wikimedia.org/P20402 and previous config saved to /var/cache/conftool/dbconfig/20220208-221545-marostegui.json

Marostegui added a comment.Feb 9 2022, 5:52 AM

s1 replicas done

Marostegui added a comment.EditedFeb 9 2022, 6:01 AM

s1 master is impossible to ALTER due to traffic, we'll need a switchover to get it done: T301312

Marostegui mentioned this in T301312: Switchover s1 master (db1118 -> db1163).Feb 9 2022, 6:03 AM
Marostegui changed the task status from Open to Stalled.Feb 9 2022, 6:05 AM
Marostegui moved this task from In progress to Unclear/blocked to proceed on the Schema-change-in-production board.
Marostegui moved this task from In progress to Blocked on the DBA board.
Jonathan5566 mentioned this in T301604: Pages are sorted by namespace then page ID rather than just page ID on Special:WhatLinksHere on Wikimedia wikis.Feb 12 2022, 2:57 AM
gerritbot added a comment.Feb 21 2022, 2:14 AM

Change 763986 had a related patch set uploaded (by Ladsgroup; author: Amir Sarabadani):

[operations/software/schema-changes@master] Add add_linter_template_T300402.py

https://gerrit.wikimedia.org/r/763986

gerritbot added a project: Patch-For-Review.Feb 21 2022, 2:14 AM
Ladsgroup removed a project: Patch-For-Review.Feb 21 2022, 2:16 AM

Sorry, wrong ticket.

Marostegui updated the task description. (Show Details)Mar 22 2022, 12:13 PM
Ladsgroup closed this task as Resolved.May 19 2022, 6:18 AM

I did s1's old master db1118 now. Sorry for the delay.

Ladsgroup updated the task description. (Show Details)May 19 2022, 6:18 AM
Ladsgroup closed subtask T301312: Switchover s1 master (db1118 -> db1163) as Resolved.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits