Page MenuHomePhabricator
Create Task
Maniphest T364069

Rebuild pagelinks tables
Open, MediumPublic
Actions

Description

Due to some sporadic corruption on s3 and s1 on some of the indexes, let's run the following on all wikis

alter table pagelinks engine=innodb,force

This should be run as a normal schema change with replication disabled (enabled for sanitarium masters)

Progress

  • s1
  • s2
    • eqiad
    • codfw
  • s3
  • s4
    • eqiad
    • codfw
  • s5
  • s6
    • eqiad
    • codfw
  • s7
    • eqiad
    • codfw
  • s8
    • eqiad (running)
    • codfw

Details

TitleReferenceAuthorSource BranchDest Branch
optimize_table: New directoryrepos/sre/schema-changes!12marosteguioptimizemain
rebuild_pagelinks_T364069.py: Schema changerepos/sre/schema-changes!10marosteguiT364069main
Customize query in GitLab

Related Objects
Search...

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Stashbot added a comment.Fri, Jun 21, 3:20 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-21T15:20:12Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2163 (T364069)', diff saved to https://phabricator.wikimedia.org/P65321 and previous config saved to /var/cache/conftool/dbconfig/20240621-152011-marostegui.json

Stashbot added a comment.Fri, Jun 21, 3:20 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-21T15:20:39Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2164 (T364069)', diff saved to https://phabricator.wikimedia.org/P65322 and previous config saved to /var/cache/conftool/dbconfig/20240621-152038-marostegui.json

Stashbot added a comment.Fri, Jun 21, 7:51 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-21T19:51:15Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2164 (T364069)', diff saved to https://phabricator.wikimedia.org/P65325 and previous config saved to /var/cache/conftool/dbconfig/20240621-195115-marostegui.json

Stashbot added a comment.Fri, Jun 21, 8:36 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-21T20:36:37Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2164 (T364069)', diff saved to https://phabricator.wikimedia.org/P65328 and previous config saved to /var/cache/conftool/dbconfig/20240621-203636-marostegui.json

Stashbot added a comment.Fri, Jun 21, 8:37 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-21T20:36:59Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2166 (T364069)', diff saved to https://phabricator.wikimedia.org/P65329 and previous config saved to /var/cache/conftool/dbconfig/20240621-203659-marostegui.json

Stashbot added a comment.Sat, Jun 22, 1:04 AM

Mentioned in SAL (#wikimedia-operations) [2024-06-22T01:04:37Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2166 (T364069)', diff saved to https://phabricator.wikimedia.org/P65335 and previous config saved to /var/cache/conftool/dbconfig/20240622-010436-marostegui.json

Stashbot added a comment.Sat, Jun 22, 1:49 AM

Mentioned in SAL (#wikimedia-operations) [2024-06-22T01:49:58Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2166 (T364069)', diff saved to https://phabricator.wikimedia.org/P65338 and previous config saved to /var/cache/conftool/dbconfig/20240622-014958-marostegui.json

Stashbot added a comment.Sat, Jun 22, 1:50 AM

Mentioned in SAL (#wikimedia-operations) [2024-06-22T01:50:20Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2167 (T364069)', diff saved to https://phabricator.wikimedia.org/P65339 and previous config saved to /var/cache/conftool/dbconfig/20240622-015020-marostegui.json

Stashbot added a comment.Sat, Jun 22, 6:02 AM

Mentioned in SAL (#wikimedia-operations) [2024-06-22T06:02:18Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2167 (T364069)', diff saved to https://phabricator.wikimedia.org/P65340 and previous config saved to /var/cache/conftool/dbconfig/20240622-060216-marostegui.json

Stashbot added a comment.Sat, Jun 22, 6:47 AM

Mentioned in SAL (#wikimedia-operations) [2024-06-22T06:47:40Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2167 (T364069)', diff saved to https://phabricator.wikimedia.org/P65343 and previous config saved to /var/cache/conftool/dbconfig/20240622-064739-marostegui.json

Stashbot added a comment.Sat, Jun 22, 6:48 AM

Mentioned in SAL (#wikimedia-operations) [2024-06-22T06:48:02Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2181 (T364069)', diff saved to https://phabricator.wikimedia.org/P65344 and previous config saved to /var/cache/conftool/dbconfig/20240622-064802-marostegui.json

Stashbot added a comment.Sat, Jun 22, 11:18 AM

Mentioned in SAL (#wikimedia-operations) [2024-06-22T11:18:43Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2181 (T364069)', diff saved to https://phabricator.wikimedia.org/P65345 and previous config saved to /var/cache/conftool/dbconfig/20240622-111842-marostegui.json

Stashbot added a comment.Sat, Jun 22, 12:04 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-22T12:04:05Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2181 (T364069)', diff saved to https://phabricator.wikimedia.org/P65348 and previous config saved to /var/cache/conftool/dbconfig/20240622-120404-marostegui.json

Stashbot added a comment.Sat, Jun 22, 12:04 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-22T12:04:38Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2195 (T364069)', diff saved to https://phabricator.wikimedia.org/P65349 and previous config saved to /var/cache/conftool/dbconfig/20240622-120437-marostegui.json

Stashbot added a comment.Sat, Jun 22, 3:33 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-22T15:33:19Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2195 (T364069)', diff saved to https://phabricator.wikimedia.org/P65350 and previous config saved to /var/cache/conftool/dbconfig/20240622-153318-marostegui.json

Stashbot added a comment.Sat, Jun 22, 4:18 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-22T16:18:41Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2195 (T364069)', diff saved to https://phabricator.wikimedia.org/P65353 and previous config saved to /var/cache/conftool/dbconfig/20240622-161841-marostegui.json

Marostegui updated the task description. (Show Details)Tue, Jun 25, 5:32 AM
Stashbot added a comment.Tue, Jun 25, 5:33 AM

Mentioned in SAL (#wikimedia-operations) [2024-06-25T05:33:13Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1167 (T364069)', diff saved to https://phabricator.wikimedia.org/P65395 and previous config saved to /var/cache/conftool/dbconfig/20240625-053312-marostegui.json

Marostegui added a subtask: T368355: Switchover s8 master (db2165 -> db2161).Tue, Jun 25, 6:25 AM
Stashbot added a comment.Tue, Jun 25, 6:33 AM

Mentioned in SAL (#wikimedia-operations) [2024-06-25T06:33:34Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1167 (T364069)', diff saved to https://phabricator.wikimedia.org/P65397 and previous config saved to /var/cache/conftool/dbconfig/20240625-063334-marostegui.json

Marostegui closed subtask T368355: Switchover s8 master (db2165 -> db2161) as Resolved.Tue, Jun 25, 7:04 AM
ops-monitoring-bot added a comment.Tue, Jun 25, 7:06 AM

Icinga downtime and Alertmanager silence (ID=4d0bf7d7-89eb-471a-bb48-dc6177969281) set by marostegui@cumin1002 for 1 day, 0:00:00 on 1 host(s) and their services with reason: Long schema change

db2165.codfw.wmnet
Stashbot added a comment.Tue, Jun 25, 7:14 AM

Mentioned in SAL (#wikimedia-operations) [2024-06-25T07:14:46Z] <marostegui> Optimize pagelinks on old s8 codfw master db2165 dbmaint T364069

Marostegui updated the task description. (Show Details)Tue, Jun 25, 7:15 AM
Stashbot added a comment.Tue, Jun 25, 7:18 AM

Mentioned in SAL (#wikimedia-operations) [2024-06-25T07:18:56Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1167 (T364069)', diff saved to https://phabricator.wikimedia.org/P65405 and previous config saved to /var/cache/conftool/dbconfig/20240625-071855-marostegui.json

Marostegui added a subtask: T368371: Switchover s8 master (db1192 -> db1209).Tue, Jun 25, 9:22 AM
Stashbot added a comment.Tue, Jun 25, 12:09 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-25T12:09:26Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1172 (T364069)', diff saved to https://phabricator.wikimedia.org/P65411 and previous config saved to /var/cache/conftool/dbconfig/20240625-120926-marostegui.json

Stashbot added a comment.Tue, Jun 25, 4:39 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-25T16:39:19Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1172 (T364069)', diff saved to https://phabricator.wikimedia.org/P65420 and previous config saved to /var/cache/conftool/dbconfig/20240625-163919-marostegui.json

Stashbot added a comment.Tue, Jun 25, 5:24 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-25T17:24:41Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1172 (T364069)', diff saved to https://phabricator.wikimedia.org/P65423 and previous config saved to /var/cache/conftool/dbconfig/20240625-172440-marostegui.json

Stashbot added a comment.Tue, Jun 25, 5:25 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-25T17:25:03Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1177 (T364069)', diff saved to https://phabricator.wikimedia.org/P65424 and previous config saved to /var/cache/conftool/dbconfig/20240625-172502-marostegui.json

Stashbot added a comment.Tue, Jun 25, 9:57 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-25T21:57:05Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1177 (T364069)', diff saved to https://phabricator.wikimedia.org/P65431 and previous config saved to /var/cache/conftool/dbconfig/20240625-215705-marostegui.json

Stashbot added a comment.Tue, Jun 25, 10:42 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-25T22:42:27Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1177 (T364069)', diff saved to https://phabricator.wikimedia.org/P65434 and previous config saved to /var/cache/conftool/dbconfig/20240625-224226-marostegui.json

Stashbot added a comment.Tue, Jun 25, 10:42 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-25T22:42:49Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1178 (T364069)', diff saved to https://phabricator.wikimedia.org/P65435 and previous config saved to /var/cache/conftool/dbconfig/20240625-224249-marostegui.json

Stashbot added a comment.Wed, Jun 26, 2:54 AM

Mentioned in SAL (#wikimedia-operations) [2024-06-26T02:54:12Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1178 (T364069)', diff saved to https://phabricator.wikimedia.org/P65441 and previous config saved to /var/cache/conftool/dbconfig/20240626-025412-marostegui.json

Stashbot added a comment.Wed, Jun 26, 3:39 AM

Mentioned in SAL (#wikimedia-operations) [2024-06-26T03:39:33Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1178 (T364069)', diff saved to https://phabricator.wikimedia.org/P65444 and previous config saved to /var/cache/conftool/dbconfig/20240626-033933-marostegui.json

Stashbot added a comment.Wed, Jun 26, 3:39 AM

Mentioned in SAL (#wikimedia-operations) [2024-06-26T03:39:55Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1193 (T364069)', diff saved to https://phabricator.wikimedia.org/P65445 and previous config saved to /var/cache/conftool/dbconfig/20240626-033955-marostegui.json

Marostegui updated the task description. (Show Details)Wed, Jun 26, 4:21 AM
Stashbot added a comment.Wed, Jun 26, 7:50 AM

Mentioned in SAL (#wikimedia-operations) [2024-06-26T07:50:43Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1193 (T364069)', diff saved to https://phabricator.wikimedia.org/P65451 and previous config saved to /var/cache/conftool/dbconfig/20240626-075043-marostegui.json

Stashbot added a comment.Wed, Jun 26, 8:37 AM

Mentioned in SAL (#wikimedia-operations) [2024-06-26T08:37:12Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1193 (T364069)', diff saved to https://phabricator.wikimedia.org/P65461 and previous config saved to /var/cache/conftool/dbconfig/20240626-083711-marostegui.json

Stashbot added a comment.Wed, Jun 26, 8:37 AM

Mentioned in SAL (#wikimedia-operations) [2024-06-26T08:37:34Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1203 (T364069)', diff saved to https://phabricator.wikimedia.org/P65462 and previous config saved to /var/cache/conftool/dbconfig/20240626-083733-marostegui.json

Stashbot added a comment.Wed, Jun 26, 12:46 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-26T12:46:55Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1203 (T364069)', diff saved to https://phabricator.wikimedia.org/P65476 and previous config saved to /var/cache/conftool/dbconfig/20240626-124654-marostegui.json

Stashbot added a comment.Wed, Jun 26, 1:32 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-26T13:32:17Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1203 (T364069)', diff saved to https://phabricator.wikimedia.org/P65480 and previous config saved to /var/cache/conftool/dbconfig/20240626-133216-marostegui.json

Stashbot added a comment.Wed, Jun 26, 1:32 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-26T13:32:41Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1209 (T364069)', diff saved to https://phabricator.wikimedia.org/P65481 and previous config saved to /var/cache/conftool/dbconfig/20240626-133239-marostegui.json

Stashbot added a comment.Wed, Jun 26, 5:38 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-26T17:38:11Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1209 (T364069)', diff saved to https://phabricator.wikimedia.org/P65486 and previous config saved to /var/cache/conftool/dbconfig/20240626-173810-marostegui.json

Stashbot added a comment.Wed, Jun 26, 6:23 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-26T18:23:34Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1209 (T364069)', diff saved to https://phabricator.wikimedia.org/P65489 and previous config saved to /var/cache/conftool/dbconfig/20240626-182333-marostegui.json

Stashbot added a comment.Wed, Jun 26, 6:24 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-26T18:24:01Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1211 (T364069)', diff saved to https://phabricator.wikimedia.org/P65490 and previous config saved to /var/cache/conftool/dbconfig/20240626-182355-marostegui.json

Stashbot added a comment.Wed, Jun 26, 10:24 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-26T22:24:37Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1211 (T364069)', diff saved to https://phabricator.wikimedia.org/P65493 and previous config saved to /var/cache/conftool/dbconfig/20240626-222434-marostegui.json

Stashbot added a comment.Wed, Jun 26, 11:10 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-26T23:09:59Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1211 (T364069)', diff saved to https://phabricator.wikimedia.org/P65496 and previous config saved to /var/cache/conftool/dbconfig/20240626-230958-marostegui.json

Stashbot added a comment.Wed, Jun 26, 11:10 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-26T23:10:21Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1214 (T364069)', diff saved to https://phabricator.wikimedia.org/P65497 and previous config saved to /var/cache/conftool/dbconfig/20240626-231020-marostegui.json

Stashbot added a comment.Thu, Jun 27, 3:10 AM

Mentioned in SAL (#wikimedia-operations) [2024-06-27T03:10:23Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1214 (T364069)', diff saved to https://phabricator.wikimedia.org/P65503 and previous config saved to /var/cache/conftool/dbconfig/20240627-031023-marostegui.json

Stashbot added a comment.Thu, Jun 27, 3:55 AM

Mentioned in SAL (#wikimedia-operations) [2024-06-27T03:55:44Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1214 (T364069)', diff saved to https://phabricator.wikimedia.org/P65506 and previous config saved to /var/cache/conftool/dbconfig/20240627-035544-marostegui.json

Stashbot added a comment.Thu, Jun 27, 8:40 AM

Mentioned in SAL (#wikimedia-operations) [2024-06-27T08:40:44Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1226 (T364069)', diff saved to https://phabricator.wikimedia.org/P65518 and previous config saved to /var/cache/conftool/dbconfig/20240627-084043-marostegui.json

Stashbot added a comment.Thu, Jun 27, 11:52 AM

Mentioned in SAL (#wikimedia-operations) [2024-06-27T11:52:45Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1226 (T364069)', diff saved to https://phabricator.wikimedia.org/P65521 and previous config saved to /var/cache/conftool/dbconfig/20240627-115244-marostegui.json

Stashbot added a comment.Thu, Jun 27, 12:38 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-27T12:38:06Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1226 (T364069)', diff saved to https://phabricator.wikimedia.org/P65527 and previous config saved to /var/cache/conftool/dbconfig/20240627-123805-marostegui.json

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits