Page MenuHomePhabricator
Create Task
Maniphest T370903

Remove cuc_actiontext, cuc_only_for_read_old, and cuc_private from cu_changes on WMF wikis
Closed, ResolvedPublic
Actions

Description

  1. ALTERs to run:
  2. Where to run those changes: all wikis
  3. When to run those changes: When DBA has time, with a note below that might be relevant
  4. If the schema change is backwards compatible: No, but the columns are no longer used on WMF production
  5. If the schema change has been tested already on some of the test/beta wikis: CheckUser is not on the beta cluster. Schema change has been applied to https://checkuser-beta-wiki.wmcloud.org/
  6. If the data should be made available on the labs replicas and/or dumps: No changes to the existing should be needed, the cu_changes table is already fully private

Note: By doing this alter the table will also be heavily optimised on some wikis. For example, on loginwiki a few weeks ago the row count dropped by 99.9% for the cu_changes table. As such, that might be useful to know for prioritisation.

Progress:

  • s1: Done
  • s2: Done
  • s3: Done
  • s4: Done
  • s5: Done
  • s6: Done
  • s7: Done
  • s8: Done

Details

Related Changes in GitLab:
TitleReferenceAuthorSource BranchDest Branch
Add drop_cuc_actiontext_T370903.pyrepos/sre/schema-changes!23ladsgroupcuc_actiontextmain
Customize query in GitLab

Related Objects
Search...

View Standalone Graph
This task is connected to more than 200 other tasks. Only direct parents and subtasks are shown here. Use View Standalone Graph to show more of the graph.
StatusSubtypeAssignedTask
· · ·
ResolvedLadsgroupT370903 Remove cuc_actiontext, cuc_only_for_read_old, and cuc_private from cu_changes on WMF wikis
ResolvedDreamy_JazzT366782 Remove now unused columns from cu_changes
DuplicateNoneT371319 Update sqoop code to remove cuc_actiontext from query and table
· · ·

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Stashbot added a comment.Nov 28 2024, 1:00 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T01:00:50Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2154 (T370903)', diff saved to https://phabricator.wikimedia.org/P71276 and previous config saved to /var/cache/conftool/dbconfig/20241128-010049-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 1:01 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T01:01:12Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2161 (T370903)', diff saved to https://phabricator.wikimedia.org/P71277 and previous config saved to /var/cache/conftool/dbconfig/20241128-010112-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 1:16 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T01:16:00Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2161 (T370903)', diff saved to https://phabricator.wikimedia.org/P71278 and previous config saved to /var/cache/conftool/dbconfig/20241128-011559-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 2:01 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T02:01:21Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2161 (T370903)', diff saved to https://phabricator.wikimedia.org/P71281 and previous config saved to /var/cache/conftool/dbconfig/20241128-020120-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 2:01 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T02:01:44Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2162 (T370903)', diff saved to https://phabricator.wikimedia.org/P71282 and previous config saved to /var/cache/conftool/dbconfig/20241128-020143-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 2:16 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T02:16:30Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2162 (T370903)', diff saved to https://phabricator.wikimedia.org/P71283 and previous config saved to /var/cache/conftool/dbconfig/20241128-021629-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 3:01 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T03:01:51Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2162 (T370903)', diff saved to https://phabricator.wikimedia.org/P71286 and previous config saved to /var/cache/conftool/dbconfig/20241128-030151-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 3:02 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T03:02:14Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2163 (T370903)', diff saved to https://phabricator.wikimedia.org/P71287 and previous config saved to /var/cache/conftool/dbconfig/20241128-030213-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 3:17 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T03:17:27Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2163 (T370903)', diff saved to https://phabricator.wikimedia.org/P71288 and previous config saved to /var/cache/conftool/dbconfig/20241128-031726-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 4:02 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T04:02:48Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2163 (T370903)', diff saved to https://phabricator.wikimedia.org/P71291 and previous config saved to /var/cache/conftool/dbconfig/20241128-040248-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 4:03 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T04:03:27Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2164 (T370903)', diff saved to https://phabricator.wikimedia.org/P71292 and previous config saved to /var/cache/conftool/dbconfig/20241128-040326-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 4:18 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T04:18:08Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2164 (T370903)', diff saved to https://phabricator.wikimedia.org/P71294 and previous config saved to /var/cache/conftool/dbconfig/20241128-041807-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 5:03 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T05:03:29Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2164 (T370903)', diff saved to https://phabricator.wikimedia.org/P71298 and previous config saved to /var/cache/conftool/dbconfig/20241128-050329-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 5:03 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T05:03:55Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2166 (T370903)', diff saved to https://phabricator.wikimedia.org/P71299 and previous config saved to /var/cache/conftool/dbconfig/20241128-050352-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 5:18 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T05:18:34Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2166 (T370903)', diff saved to https://phabricator.wikimedia.org/P71300 and previous config saved to /var/cache/conftool/dbconfig/20241128-051833-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 6:03 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T06:03:56Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2166 (T370903)', diff saved to https://phabricator.wikimedia.org/P71303 and previous config saved to /var/cache/conftool/dbconfig/20241128-060355-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 6:04 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T06:04:19Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2167 (T370903)', diff saved to https://phabricator.wikimedia.org/P71304 and previous config saved to /var/cache/conftool/dbconfig/20241128-060418-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 6:16 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T06:16:48Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2167 (T370903)', diff saved to https://phabricator.wikimedia.org/P71305 and previous config saved to /var/cache/conftool/dbconfig/20241128-061647-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 7:02 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T07:02:11Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2167 (T370903)', diff saved to https://phabricator.wikimedia.org/P71308 and previous config saved to /var/cache/conftool/dbconfig/20241128-070209-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 7:02 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T07:02:32Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2181 (T370903)', diff saved to https://phabricator.wikimedia.org/P71309 and previous config saved to /var/cache/conftool/dbconfig/20241128-070231-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 7:17 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T07:17:00Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2181 (T370903)', diff saved to https://phabricator.wikimedia.org/P71310 and previous config saved to /var/cache/conftool/dbconfig/20241128-071700-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 8:02 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T08:02:21Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2181 (T370903)', diff saved to https://phabricator.wikimedia.org/P71314 and previous config saved to /var/cache/conftool/dbconfig/20241128-080221-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 8:02 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T08:02:44Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2195 (T370903)', diff saved to https://phabricator.wikimedia.org/P71315 and previous config saved to /var/cache/conftool/dbconfig/20241128-080244-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 8:15 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T08:15:15Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2195 (T370903)', diff saved to https://phabricator.wikimedia.org/P71316 and previous config saved to /var/cache/conftool/dbconfig/20241128-081514-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 9:00 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T09:00:36Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2195 (T370903)', diff saved to https://phabricator.wikimedia.org/P71319 and previous config saved to /var/cache/conftool/dbconfig/20241128-090035-ladsgroup.json

Ladsgroup updated the task description. (Show Details)Nov 28 2024, 11:06 AM
Ladsgroup updated the task description. (Show Details)Nov 28 2024, 11:08 AM
Ladsgroup updated the task description. (Show Details)
Stashbot added a comment.Nov 28 2024, 11:13 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T11:13:01Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db1236 (T370903)', diff saved to https://phabricator.wikimedia.org/P71326 and previous config saved to /var/cache/conftool/dbconfig/20241128-111300-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 11:15 AM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T11:15:10Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1236 (T370903)', diff saved to https://phabricator.wikimedia.org/P71327 and previous config saved to /var/cache/conftool/dbconfig/20241128-111510-ladsgroup.json

Stashbot added a comment.Nov 28 2024, 12:00 PM

Mentioned in SAL (#wikimedia-operations) [2024-11-28T12:00:31Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1236 (T370903)', diff saved to https://phabricator.wikimedia.org/P71338 and previous config saved to /var/cache/conftool/dbconfig/20241128-120031-ladsgroup.json

Ladsgroup updated the task description. (Show Details)Nov 28 2024, 12:02 PM
Ladsgroup added a comment.Nov 28 2024, 2:01 PM

@Dreamy_Jazz So this is done for everything except the masters of a couple of sections that require switchovers (and read only time). We need to do them anyway for other reasons but for now it has stay as is. The report won't be affected much anyway. Let me run it again.

Dreamy_Jazz added a comment.Nov 28 2024, 5:06 PM
In T370903#10365511, @Ladsgroup wrote:

@Dreamy_Jazz So this is done for everything except the masters of a couple of sections that require switchovers (and read only time). We need to do them anyway for other reasons but for now it has stay as is. The report won't be affected much anyway. Let me run it again.

Thanks!

Ladsgroup mentioned this in T321063: Fix CheckUser database schema drifts in production.Nov 28 2024, 10:16 PM
Ahoelzl moved this task from Next Up to If we have time on the Data-Engineering (Q2 2024 October 1st - December 31th) board.Dec 18 2024, 1:56 PM
Restricted Application added a project: Trust and Safety Product Team. · View Herald TranscriptDec 18 2024, 1:56 PM
Stashbot added a comment.Jan 6 2025, 4:42 PM

Mentioned in SAL (#wikimedia-operations) [2025-01-06T16:42:16Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db1193 (T370903)', diff saved to https://phabricator.wikimedia.org/P71813 and previous config saved to /var/cache/conftool/dbconfig/20250106-164215-ladsgroup.json

Stashbot added a comment.Jan 6 2025, 4:55 PM

Mentioned in SAL (#wikimedia-operations) [2025-01-06T16:55:04Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1193 (T370903)', diff saved to https://phabricator.wikimedia.org/P71815 and previous config saved to /var/cache/conftool/dbconfig/20250106-165503-ladsgroup.json

Ladsgroup updated the task description. (Show Details)Jan 6 2025, 5:34 PM
Ladsgroup updated the task description. (Show Details)
Stashbot added a comment.Jan 6 2025, 5:40 PM

Mentioned in SAL (#wikimedia-operations) [2025-01-06T17:40:25Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1193 (T370903)', diff saved to https://phabricator.wikimedia.org/P71818 and previous config saved to /var/cache/conftool/dbconfig/20250106-174024-ladsgroup.json

• VirginiaPoundstone removed a project: Test Kitchen.Jan 6 2025, 9:28 PM
• Marostegui updated the task description. (Show Details)Jan 10 2025, 4:59 PM
Stashbot added a comment.Jan 15 2025, 11:27 PM

Mentioned in SAL (#wikimedia-operations) [2025-01-15T23:27:37Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db1163 (T370903)', diff saved to https://phabricator.wikimedia.org/P72087 and previous config saved to /var/cache/conftool/dbconfig/20250115-232737-ladsgroup.json

Stashbot added a comment.Jan 15 2025, 11:36 PM

Mentioned in SAL (#wikimedia-operations) [2025-01-15T23:36:17Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1163 (T370903)', diff saved to https://phabricator.wikimedia.org/P72088 and previous config saved to /var/cache/conftool/dbconfig/20250115-233617-ladsgroup.json

Stashbot added a comment.Jan 16 2025, 12:21 AM

Mentioned in SAL (#wikimedia-operations) [2025-01-16T00:21:38Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1163 (T370903)', diff saved to https://phabricator.wikimedia.org/P72091 and previous config saved to /var/cache/conftool/dbconfig/20250116-002137-ladsgroup.json

Ladsgroup updated the task description. (Show Details)Jan 16 2025, 12:25 AM
Ahoelzl edited projects, added Data-Engineering; removed Data-Engineering (Q2 2024 October 1st - December 31th).Jan 18 2025, 12:27 AM
Ahoelzl moved this task from Q2 2024 October 1st - December 31th to Next Up on the Data-Engineering board.
Ladsgroup updated the task description. (Show Details)Feb 5 2025, 12:16 PM
Dreamy_Jazz moved this task from Inbox to Tracking work by others on the Trust and Safety Product Team board.Feb 28 2025, 6:49 PM
Stashbot added a comment.Apr 1 2025, 1:21 PM

Mentioned in SAL (#wikimedia-operations) [2025-04-01T13:20:59Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db1160 (T370903)', diff saved to https://phabricator.wikimedia.org/P74536 and previous config saved to /var/cache/conftool/dbconfig/20250401-132059-ladsgroup.json

Stashbot added a comment.Apr 1 2025, 1:24 PM

Mentioned in SAL (#wikimedia-operations) [2025-04-01T13:24:08Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2165 (T370903)', diff saved to https://phabricator.wikimedia.org/P74537 and previous config saved to /var/cache/conftool/dbconfig/20250401-132407-ladsgroup.json

Stashbot added a comment.Apr 1 2025, 1:37 PM

Mentioned in SAL (#wikimedia-operations) [2025-04-01T13:37:08Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2165 (T370903)', diff saved to https://phabricator.wikimedia.org/P74539 and previous config saved to /var/cache/conftool/dbconfig/20250401-133707-ladsgroup.json

Stashbot added a comment.Apr 1 2025, 1:39 PM

Mentioned in SAL (#wikimedia-operations) [2025-04-01T13:39:55Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1160 (T370903)', diff saved to https://phabricator.wikimedia.org/P74540 and previous config saved to /var/cache/conftool/dbconfig/20250401-133954-ladsgroup.json

Stashbot added a comment.Apr 1 2025, 2:22 PM

Mentioned in SAL (#wikimedia-operations) [2025-04-01T14:22:29Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2165 (T370903)', diff saved to https://phabricator.wikimedia.org/P74546 and previous config saved to /var/cache/conftool/dbconfig/20250401-142228-ladsgroup.json

Stashbot added a comment.Apr 1 2025, 2:25 PM

Mentioned in SAL (#wikimedia-operations) [2025-04-01T14:25:16Z] <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1160 (T370903)', diff saved to https://phabricator.wikimedia.org/P74547 and previous config saved to /var/cache/conftool/dbconfig/20250401-142516-ladsgroup.json

Ladsgroup closed this task as Resolved.Apr 1 2025, 2:29 PM
Ladsgroup updated the task description. (Show Details)
Maintenance_bot moved this task from In progress to Done on the DBA board.Apr 1 2025, 3:29 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits