Page MenuHomePhabricator
Create Task
Maniphest T285139

DB maintenance work to do while eqiad is passive (June 2021)
Closed, ResolvedPublic
Actions

Description

Tracking task with all the tasks that we have to do while eqiad is passive.

Related Objects
Search...

StatusSubtypeAssignedTask
Unknown Object (Task)
 Resolved• MarosteguiT258361 Productionize db1155-db1175 and refresh and decommission db1074-db1095 (22 servers)
 DeclinedNoneT258386 db1080-95 batch possibly suffering BBU issues
 Resolved• MarosteguiT258336 db1082 crashed
 ResolvedJclark-ctrT258910 Remove db1082's BBU on-site
 Resolved• MarosteguiT258360 db1085 crashed
 Resolved• MarosteguiT264755 db1076 crashed - BBU failure
 ResolvedRequestwiki_willyT267088 decommission db1091.eqiad.wmnet
Restricted Task
 ResolvedLegoktmT281515 June 2021 Datacenter switchover
 Resolved• MarosteguiT285139 DB maintenance work to do while eqiad is passive (June 2021)
 Resolved• MarosteguiT167973 Move database for wikitech (labswiki) to a main cluster section
 ResolvedAndrewT188029 Move labswiki database to m5
Resolved• MarosteguiT282074 Audit labswiki grants
 ResolvedAndrewT282209 Enable connection from labweb1001/labweb1002 to s6
 DeclinedAndrewT282573 Move labweb/cloudweb hosts to private IPs
 ResolvedAndrewT284106 Replicate & sanitize wikitech data
 ResolvedAndrewT284108 Bring labswiki database tables up to date
 ResolvedLadsgroupT269348 wikitech database has almost all of its varbinary fields wrong
 DuplicateNoneT284736 Create views on labswiki on clouddb* hosts
 ResolvedBstormT287442 Create views for labswiki (wikitech)
 Resolved• MarosteguiT283093 Schema change for making cuc_id in cu_changes unsigned
Restricted Task
Restricted Task
Restricted Task
 ResolvedBTullisT298940 Reimage WMCS db proxies to Bullseye
 Resolved• MarosteguiT287852 Failover m2 master (db1107) to a different host to upgrade its kernel
 Resolved• MarosteguiT288197 Failover m3 (phabricator) master (db1132) to a different host to upgrade its kernel
 Resolved• MarosteguiT266483 Enable report_host for mariadb
 ResolvedKormatT271106 Enable report_host on candidate masters
 Resolved• MarosteguiT271427 Switchover s4 (commonswiki) from db1081 to db1138
 ResolvedTrizek-WMFT271791 Database primary master failover on s4 (commonswiki)
 ResolvedKormatT272954 Fix db-switchover update zarcillo part
 Resolved• MarosteguiT272568 Add m* and es4/es5 sections to Orchestrator
 Resolved• MarosteguiT271540 Upgrade and restart m1 master (db1080)
 Resolved• MarosteguiT272596 Restart m3 (phabricator) database master db1132
 Resolved• MarosteguiT272388 Restart m5 master (db1128)
 Resolved• MarosteguiT272964 Restart m2 database master (db1107)
 Resolved• MarosteguiT273758 Restart x1 database master (db1103)
 ResolvedsgrabarczukT273762 Read only time for extension 1 (x1) primary database on 2021-02-17
 Resolved• MarosteguiT274336 Switchover s7 from db1086 to db1136
 ResolvedsgrabarczukT276899 Read only time window needed for s7
 ResolvedCmjohnsonT277007 Upgrade firmware on db1136
 Resolved• MarosteguiT278214 Switchover s1 from db1083 to db1163
 Resolved• MarosteguiT276150 Schema change to make rc_id unsigned and rc_timestamp BINARY
 ResolvedsgrabarczukT279505 Read only time window needed for s1 (enwiki)
 ResolvedRequestCmjohnsonT281445 decommission db1083.eqiad.wmnet
 Resolved• MarosteguiT280492 Upgrade all sanitarium masters to 10.4 and Buster
 ResolvedRequestwiki_willyT281794 decommission db1082.eqiad.wmnet
 ResolvedRequestCmjohnsonT281959 decommission db1074.eqiad.wmnet
 ResolvedRequestCmjohnsonT282079 decommission db1079.eqiad.wmnet
 ResolvedRequestCmjohnsonT282093 decommission db1087.eqiad.wmnet
 ResolvedRequestCmjohnsonT282096 decommission db1085.eqiad.wmnet
 Resolved• MarosteguiT284375 Rename name_title index on page to page_name_title
 Resolved• MarosteguiT284619 Schema change for renaming several indexes in change_tag table
 Resolved• MarosteguiT273360 Schema change for dropping default of img_timestamp and making it binary(14)
 Resolved• MarosteguiT268392 Schema change for watchlist.wl_notificationtimestamp going binary(14) from varbinary(14)
 Resolved• MarosteguiT266486 Schema change to turn user_last_timestamp.user_newtalk to binary(14)
 ResolvedKormatT283131 Upgrade s3 to Debian Buster and MariaDB 10.4
 ResolvedKormatT284648 Switchover s3 from db1123 to db1157
 ResolvedTrizek-WMFT284650 Read-only window needed for s3 (~900 wikis)
 Resolved• MarosteguiT283235 Upgrade s5 to Debian Buster and MariaDB 10.4
 Resolved• MarosteguiT284529 Switchover s5 from db1100 to db1130
 ResolvedsgrabarczukT284530 Read only time window needed for s5
 Resolved• MarosteguiT277123 Extend iwlinks.iwl_prefix to VARBINARY(32)
 ResolvedKormatT277118 iw_url in interwiki is varbinary(127) in production but blob in code
 Resolved• MarosteguiT283499 Schema change for renaming page_timestamp index on revision table to rev_page_timestamp
 Resolved• MarosteguiT278621 job_cmd is varbinary(255) in production while being varbinary(60) in code since 2007
 ResolvedKormatT277116 fa_deleted_timestamp and fa_timestamp are binary(14) in code but varbinary(14) in production
 Resolved• MarosteguiT287344 Please optimize logging table in dewiki
 Resolved• MarosteguiT288273 Please optimize image table in commonswiki
 Resolved• MarosteguiT290057 Optimize flaggedtemplates tables in production
 Resolved• MarosteguiT286102 Please optimize logging table in ruwiki
 Resolved• MarosteguiT270620 Schema change for renaming several indexes in logging table

Event Timeline

• Marostegui created this task.Jun 18 2021, 11:09 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 18 2021, 11:09 AM
• Marostegui triaged this task as Medium priority.Jun 18 2021, 11:09 AM
• Marostegui moved this task from Triage to Meta/Epic on the DBA board.
• Marostegui added a subtask: T167973: Move database for wikitech (labswiki) to a main cluster section.
• Marostegui added subtasks: T283093: Schema change for making cuc_id in cu_changes unsigned, Restricted Task, Restricted Task, T266483: Enable report_host for mariadb, T284375: Rename name_title index on page to page_name_title, T284619: Schema change for renaming several indexes in change_tag table, T273360: Schema change for dropping default of img_timestamp and making it binary(14), T268392: Schema change for watchlist.wl_notificationtimestamp going binary(14) from varbinary(14), T266486: Schema change to turn user_last_timestamp.user_newtalk to binary(14), T276150: Schema change to make rc_id unsigned and rc_timestamp BINARY.Jun 18 2021, 11:14 AM
• Marostegui added a subtask: T277116: fa_deleted_timestamp and fa_timestamp are binary(14) in code but varbinary(14) in production.
Ladsgroup awarded a token.Jun 18 2021, 11:17 AM
• Marostegui added a subtask: T277123: Extend iwlinks.iwl_prefix to VARBINARY(32).Jun 18 2021, 11:17 AM
• Marostegui added a subtask: T277118: iw_url in interwiki is varbinary(127) in production but blob in code.
• Marostegui added a parent task: T278621: job_cmd is varbinary(255) in production while being varbinary(60) in code since 2007.
• Marostegui added a subtask: T283499: Schema change for renaming page_timestamp index on revision table to rev_page_timestamp.Jun 18 2021, 11:19 AM
• Marostegui added a parent task: T281515: June 2021 Datacenter switchover.
• Marostegui removed a parent task: T278621: job_cmd is varbinary(255) in production while being varbinary(60) in code since 2007.Jun 18 2021, 12:18 PM
• Marostegui added a subtask: T278621: job_cmd is varbinary(255) in production while being varbinary(60) in code since 2007.
Krinkle renamed this task from DB maintenance work to do while eqiad is passive to DB maintenance work to do while eqiad is passive (June 2021).Jun 18 2021, 9:11 PM
• Marostegui closed subtask T266483: Enable report_host for mariadb as Resolved.Jul 1 2021, 5:42 AM
• Marostegui closed subtask T277123: Extend iwlinks.iwl_prefix to VARBINARY(32) as Resolved.Jul 1 2021, 11:32 AM
• Marostegui changed the status of subtask T276150: Schema change to make rc_id unsigned and rc_timestamp BINARY from Stalled to Open.Jul 1 2021, 1:01 PM
• Marostegui changed the status of subtask T266486: Schema change to turn user_last_timestamp.user_newtalk to binary(14) from Stalled to Open.Jul 1 2021, 2:22 PM
• Marostegui changed the status of subtask T268392: Schema change for watchlist.wl_notificationtimestamp going binary(14) from varbinary(14) from Stalled to Open.
• Marostegui closed subtask T266486: Schema change to turn user_last_timestamp.user_newtalk to binary(14) as Resolved.Jul 1 2021, 4:08 PM
• Marostegui closed subtask T284375: Rename name_title index on page to page_name_title as Resolved.Jul 2 2021, 1:23 PM
• Marostegui changed the status of subtask T273360: Schema change for dropping default of img_timestamp and making it binary(14) from Stalled to Open.Jul 5 2021, 6:35 AM
• Marostegui closed subtask T268392: Schema change for watchlist.wl_notificationtimestamp going binary(14) from varbinary(14) as Resolved.Jul 5 2021, 9:19 AM
• Marostegui closed subtask T273360: Schema change for dropping default of img_timestamp and making it binary(14) as Resolved.Jul 6 2021, 4:22 AM
• Marostegui closed subtask T283093: Schema change for making cuc_id in cu_changes unsigned as Resolved.Jul 6 2021, 5:11 AM
• Marostegui closed subtask T284619: Schema change for renaming several indexes in change_tag table as Resolved.Jul 6 2021, 6:31 AM
• Marostegui closed subtask T278621: job_cmd is varbinary(255) in production while being varbinary(60) in code since 2007 as Resolved.Jul 7 2021, 6:24 AM
• Marostegui closed subtask T276150: Schema change to make rc_id unsigned and rc_timestamp BINARY as Resolved.Jul 7 2021, 12:02 PM
• Marostegui changed the status of subtask T283499: Schema change for renaming page_timestamp index on revision table to rev_page_timestamp from Open to Stalled.Jul 8 2021, 10:50 AM
Kormat changed the status of subtask T277116: fa_deleted_timestamp and fa_timestamp are binary(14) in code but varbinary(14) in production from Open to Stalled.Jul 13 2021, 11:36 AM
Kormat changed the status of subtask T277118: iw_url in interwiki is varbinary(127) in production but blob in code from Open to Stalled.Jul 14 2021, 1:10 PM
• Marostegui added a subtask: T287344: Please optimize logging table in dewiki.Jul 26 2021, 5:49 AM
• Marostegui added a subtask: T288273: Please optimize image table in commonswiki.Aug 5 2021, 5:28 PM
• Marostegui added a subtask: T290057: Optimize flaggedtemplates tables in production.Aug 31 2021, 7:42 AM
• Marostegui closed subtask Restricted Task as Resolved.Sep 2 2021, 8:18 AM
• Marostegui added a subtask: T286102: Please optimize logging table in ruwiki.Sep 15 2021, 5:23 AM
• Marostegui added a subtask: T270620: Schema change for renaming several indexes in logging table.
• Marostegui changed the status of subtask T286102: Please optimize logging table in ruwiki from Stalled to Open.Sep 15 2021, 5:31 AM
• Marostegui changed the status of subtask T270620: Schema change for renaming several indexes in logging table from Stalled to Open.
• Marostegui closed subtask T287344: Please optimize logging table in dewiki as Resolved.Sep 16 2021, 8:34 AM
• Marostegui closed subtask T290057: Optimize flaggedtemplates tables in production as Resolved.Sep 22 2021, 10:30 AM
• Marostegui closed subtask T286102: Please optimize logging table in ruwiki as Resolved.Sep 23 2021, 5:50 AM
• Marostegui closed subtask T167973: Move database for wikitech (labswiki) to a main cluster section as Resolved.Sep 27 2021, 8:19 AM
• Marostegui closed subtask T288273: Please optimize image table in commonswiki as Resolved.Sep 27 2021, 2:34 PM
• Marostegui changed the status of subtask T283499: Schema change for renaming page_timestamp index on revision table to rev_page_timestamp from Stalled to Open.Sep 28 2021, 5:28 AM
• Marostegui closed subtask T283499: Schema change for renaming page_timestamp index on revision table to rev_page_timestamp as Resolved.Sep 29 2021, 11:50 AM
• Marostegui closed subtask T270620: Schema change for renaming several indexes in logging table as Resolved.Sep 30 2021, 7:01 AM
• Marostegui changed the status of subtask T277118: iw_url in interwiki is varbinary(127) in production but blob in code from Stalled to Open.Oct 19 2021, 5:36 AM
• Marostegui changed the status of subtask T277116: fa_deleted_timestamp and fa_timestamp are binary(14) in code but varbinary(14) in production from Stalled to Open.
• Marostegui closed subtask Restricted Task as Resolved.Oct 19 2021, 9:33 AM
Kormat closed subtask T277118: iw_url in interwiki is varbinary(127) in production but blob in code as Resolved.Oct 20 2021, 8:06 AM
Kormat closed subtask T277116: fa_deleted_timestamp and fa_timestamp are binary(14) in code but varbinary(14) in production as Resolved.Oct 20 2021, 3:10 PM
• Marostegui closed this task as Resolved.Oct 20 2021, 3:14 PM
• Marostegui claimed this task.

Closing this as done. The only two associated tasks aren't strictly DB (and we don't own them).
Massive effort! Happy to close this!

Content licensed under Creative Commons Attribution-ShareAlike 4.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL