Page MenuHomePhabricator
Create Task
Maniphest T312160

Adjust the field type of cx_corpora.cxc_timestamp to fixed binary on wmf wikis
Closed, ResolvedPublic
Actions

Description

Apply parts of T310448 to wmf wikis

  1. ALTERs to run: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/ContentTranslation/+/804775/3/sql/patch-cx_corpora-timestamp.sql
  2. Where to run those changes: All wikipedias (tables on x1.wikishared) + testwiki
  3. When to run those changes: any time
  4. If the schema change is backwards compatible: Yes
  5. If the schema change has been tested already on some of the test/beta wikis: beta cluster is running with the new schema
  6. if the data should be made available on the labs replicas and/or dumps: no change of the existing rules

Progress

  • s3 (testwiki)
  • x1 (wikishared)

Related Objects
Search...

Event Timeline

Umherirrender created this task.Jul 5 2022, 7:55 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 5 2022, 7:55 PM
Umherirrender triaged this task as Low priority.Jul 5 2022, 7:58 PM
Umherirrender updated the task description. (Show Details)
• Marostegui moved this task from Triage to Ready on the DBA board.Jul 6 2022, 5:44 AM
• Marostegui subscribed.

This table in x1 is 93GB, so we'd need to first change x1 to become SBR before being able to deploy this on the replicas.

• Marostegui mentioned this in T312574: Adjust the field type of flow_revision.rev_mod_timestamp to fixed binary on wmf wikis.Jul 8 2022, 5:23 AM
• Marostegui claimed this task.Aug 24 2022, 6:35 AM
• Marostegui updated the task description. (Show Details)
Stashbot added a comment.Aug 24 2022, 6:37 AM

Mentioned in SAL (#wikimedia-operations) [2022-08-24T06:37:09Z] <marostegui> dbmaint s3 T312160

• Marostegui added a comment.Aug 24 2022, 6:37 AM

s3 done with replication

• Marostegui updated the task description. (Show Details)Aug 24 2022, 6:37 AM
• Marostegui moved this task from Ready to In progress on the DBA board.
Ladsgroup subscribed.Aug 25 2022, 7:42 AM

I'm running it on x1 now.

Stashbot added a comment.Aug 25 2022, 7:42 AM

Mentioned in SAL (#wikimedia-operations) [2022-08-25T07:42:21Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1137 (T312160)', diff saved to https://phabricator.wikimedia.org/P33038 and previous config saved to /var/cache/conftool/dbconfig/20220825-074220-ladsgroup.json

Stashbot added a comment.Aug 25 2022, 9:23 AM

Mentioned in SAL (#wikimedia-operations) [2022-08-25T09:23:57Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1137 (T312160)', diff saved to https://phabricator.wikimedia.org/P33085 and previous config saved to /var/cache/conftool/dbconfig/20220825-092356-ladsgroup.json

Stashbot added a comment.Aug 25 2022, 10:09 AM

Mentioned in SAL (#wikimedia-operations) [2022-08-25T10:09:15Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1137 (T312160)', diff saved to https://phabricator.wikimedia.org/P33102 and previous config saved to /var/cache/conftool/dbconfig/20220825-100915-ladsgroup.json

Stashbot added a comment.Aug 25 2022, 1:43 PM

Mentioned in SAL (#wikimedia-operations) [2022-08-25T13:43:19Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1120 (T312160)', diff saved to https://phabricator.wikimedia.org/P33115 and previous config saved to /var/cache/conftool/dbconfig/20220825-134318-ladsgroup.json

Stashbot added a comment.Aug 25 2022, 3:17 PM

Mentioned in SAL (#wikimedia-operations) [2022-08-25T15:17:32Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1120 (T312160)', diff saved to https://phabricator.wikimedia.org/P33118 and previous config saved to /var/cache/conftool/dbconfig/20220825-151731-ladsgroup.json

Stashbot added a comment.Aug 25 2022, 4:02 PM

Mentioned in SAL (#wikimedia-operations) [2022-08-25T16:02:50Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1120 (T312160)', diff saved to https://phabricator.wikimedia.org/P33128 and previous config saved to /var/cache/conftool/dbconfig/20220825-160250-ladsgroup.json

Stashbot added a comment.Aug 25 2022, 5:48 PM

Mentioned in SAL (#wikimedia-operations) [2022-08-25T17:48:26Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db2115 (T312160)', diff saved to https://phabricator.wikimedia.org/P33137 and previous config saved to /var/cache/conftool/dbconfig/20220825-174826-ladsgroup.json

Stashbot added a comment.Aug 25 2022, 7:32 PM

Mentioned in SAL (#wikimedia-operations) [2022-08-25T19:32:38Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2115 (T312160)', diff saved to https://phabricator.wikimedia.org/P33147 and previous config saved to /var/cache/conftool/dbconfig/20220825-193238-ladsgroup.json

Stashbot added a comment.Aug 25 2022, 8:17 PM

Mentioned in SAL (#wikimedia-operations) [2022-08-25T20:17:57Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2115 (T312160)', diff saved to https://phabricator.wikimedia.org/P33155 and previous config saved to /var/cache/conftool/dbconfig/20220825-201756-ladsgroup.json

Stashbot added a comment.Aug 25 2022, 10:09 PM

Mentioned in SAL (#wikimedia-operations) [2022-08-25T22:09:38Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db2131 (T312160)', diff saved to https://phabricator.wikimedia.org/P33165 and previous config saved to /var/cache/conftool/dbconfig/20220825-220937-ladsgroup.json

Stashbot added a comment.Aug 25 2022, 11:53 PM

Mentioned in SAL (#wikimedia-operations) [2022-08-25T23:53:01Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2131 (T312160)', diff saved to https://phabricator.wikimedia.org/P33169 and previous config saved to /var/cache/conftool/dbconfig/20220825-235300-ladsgroup.json

Stashbot added a comment.Aug 26 2022, 12:38 AM

Mentioned in SAL (#wikimedia-operations) [2022-08-26T00:38:19Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2131 (T312160)', diff saved to https://phabricator.wikimedia.org/P33172 and previous config saved to /var/cache/conftool/dbconfig/20220826-003819-ladsgroup.json

Ladsgroup added a comment.Aug 26 2022, 7:50 AM

This is done on all replicas except masters of eqiad and codfw.

• Marostegui added a subtask: T316522: Switchover x1 codfw master (db2096 -> db2115).Aug 29 2022, 12:38 PM
• Marostegui closed subtask T316522: Switchover x1 codfw master (db2096 -> db2115) as Resolved.Aug 30 2022, 8:39 AM
Ladsgroup added a comment.Aug 30 2022, 10:40 AM

db2096 is done, only x1 master left.

• Marostegui added a comment.Sep 6 2022, 6:10 AM

Running this on x1 eqiad old master (db1103)

• Marostegui mentioned this in T316745: Switchover x1 master (db1103 -> db1120).Sep 6 2022, 6:10 AM
• Marostegui added a comment.Sep 6 2022, 7:47 AM

The old master is done:

root@db1103.eqiad.wmnet[wikishared]> ALTER TABLE  /*_*/cx_corpora
    -> CHANGE  cxc_timestamp cxc_timestamp binary(14);
Query OK, 46832972 rows affected (1 hour 37 min 44.708 sec)
Records: 46832972  Duplicates: 0  Warnings: 0

root@db1103.eqiad.wmnet[wikishared]>
• Marostegui closed this task as Resolved.Sep 6 2022, 7:48 AM
• Marostegui updated the task description. (Show Details)
Maintenance_bot moved this task from In progress to Done on the DBA board.Sep 6 2022, 8:15 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits