Page MenuHomePhabricator

Adjust the field type of cx_corpora.cxc_timestamp to fixed binary on wmf wikis
Closed, ResolvedPublic

Description

Apply parts of T310448 to wmf wikis

  1. ALTERs to run: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/ContentTranslation/+/804775/3/sql/patch-cx_corpora-timestamp.sql
  2. Where to run those changes: All wikipedias (tables on x1.wikishared) + testwiki
  3. When to run those changes: any time
  4. If the schema change is backwards compatible: Yes
  5. If the schema change has been tested already on some of the test/beta wikis: beta cluster is running with the new schema
  6. if the data should be made available on the labs replicas and/or dumps: no change of the existing rules

Progress

  • s3 (testwiki)
  • x1 (wikishared)

Event Timeline

Umherirrender updated the task description. (Show Details)
Marostegui subscribed.

This table in x1 is 93GB, so we'd need to first change x1 to become SBR before being able to deploy this on the replicas.

Marostegui moved this task from Ready to In progress on the DBA board.

Mentioned in SAL (#wikimedia-operations) [2022-08-25T07:42:21Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1137 (T312160)', diff saved to https://phabricator.wikimedia.org/P33038 and previous config saved to /var/cache/conftool/dbconfig/20220825-074220-ladsgroup.json

Mentioned in SAL (#wikimedia-operations) [2022-08-25T09:23:57Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1137 (T312160)', diff saved to https://phabricator.wikimedia.org/P33085 and previous config saved to /var/cache/conftool/dbconfig/20220825-092356-ladsgroup.json

Mentioned in SAL (#wikimedia-operations) [2022-08-25T10:09:15Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1137 (T312160)', diff saved to https://phabricator.wikimedia.org/P33102 and previous config saved to /var/cache/conftool/dbconfig/20220825-100915-ladsgroup.json

Mentioned in SAL (#wikimedia-operations) [2022-08-25T13:43:19Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1120 (T312160)', diff saved to https://phabricator.wikimedia.org/P33115 and previous config saved to /var/cache/conftool/dbconfig/20220825-134318-ladsgroup.json

Mentioned in SAL (#wikimedia-operations) [2022-08-25T15:17:32Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1120 (T312160)', diff saved to https://phabricator.wikimedia.org/P33118 and previous config saved to /var/cache/conftool/dbconfig/20220825-151731-ladsgroup.json

Mentioned in SAL (#wikimedia-operations) [2022-08-25T16:02:50Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1120 (T312160)', diff saved to https://phabricator.wikimedia.org/P33128 and previous config saved to /var/cache/conftool/dbconfig/20220825-160250-ladsgroup.json

Mentioned in SAL (#wikimedia-operations) [2022-08-25T17:48:26Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db2115 (T312160)', diff saved to https://phabricator.wikimedia.org/P33137 and previous config saved to /var/cache/conftool/dbconfig/20220825-174826-ladsgroup.json

Mentioned in SAL (#wikimedia-operations) [2022-08-25T19:32:38Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2115 (T312160)', diff saved to https://phabricator.wikimedia.org/P33147 and previous config saved to /var/cache/conftool/dbconfig/20220825-193238-ladsgroup.json

Mentioned in SAL (#wikimedia-operations) [2022-08-25T20:17:57Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2115 (T312160)', diff saved to https://phabricator.wikimedia.org/P33155 and previous config saved to /var/cache/conftool/dbconfig/20220825-201756-ladsgroup.json

Mentioned in SAL (#wikimedia-operations) [2022-08-25T22:09:38Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db2131 (T312160)', diff saved to https://phabricator.wikimedia.org/P33165 and previous config saved to /var/cache/conftool/dbconfig/20220825-220937-ladsgroup.json

Mentioned in SAL (#wikimedia-operations) [2022-08-25T23:53:01Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2131 (T312160)', diff saved to https://phabricator.wikimedia.org/P33169 and previous config saved to /var/cache/conftool/dbconfig/20220825-235300-ladsgroup.json

Mentioned in SAL (#wikimedia-operations) [2022-08-26T00:38:19Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2131 (T312160)', diff saved to https://phabricator.wikimedia.org/P33172 and previous config saved to /var/cache/conftool/dbconfig/20220826-003819-ladsgroup.json

This is done on all replicas except masters of eqiad and codfw.

db2096 is done, only x1 master left.

Running this on x1 eqiad old master (db1103)

The old master is done:

root@db1103.eqiad.wmnet[wikishared]> ALTER TABLE  /*_*/cx_corpora
    -> CHANGE  cxc_timestamp cxc_timestamp binary(14);
Query OK, 46832972 rows affected (1 hour 37 min 44.708 sec)
Records: 46832972  Duplicates: 0  Warnings: 0

root@db1103.eqiad.wmnet[wikishared]>
Marostegui updated the task description. (Show Details)