Page MenuHomePhabricator
Create Task
Maniphest T136425

Remove orphaned echo_event rows
Closed, ResolvedPublic
Actions

Description

On enwiki, there are about 80M rows in the echo_event table, but only 18M of them have echo_notification rows pointing to them. That leaves 62M orphans. We should change the notification removal code to delete orphaned events, and also do a one-off cleanup removing those 62M orphans.

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
Add script to remove orphaned event rowsmediawiki/extensions/Echomaster+72 -0
Customize query in gerrit

Related Objects

Event Timeline

Catrope created this task.May 27 2016, 5:42 PM
Restricted Application added subscribers: Zppix, Aklapper. · View Herald TranscriptMay 27 2016, 5:42 PM
Catrope mentioned this in T136427: Remove event_page_namespace and event_page_title.May 27 2016, 5:48 PM
Catrope mentioned this in T135699: Schema changes for Echo moderation.May 27 2016, 5:55 PM
• jmatazzoni edited projects, added Collaboration-Team-Triage; removed Collab-Team-2016-Apr-Jun-Q4.Jun 1 2016, 12:20 AM
• jmatazzoni moved this task from Untriaged to Hot on the Collaboration-Team-Triage board.
gerritbot subscribed.Jun 6 2016, 6:28 PM

Change 292974 had a related patch set uploaded (by Catrope):
Add script to remove orphaned event rows

https://gerrit.wikimedia.org/r/292974

gerritbot added a project: Patch-For-Review.Jun 6 2016, 6:28 PM
gerritbot added a comment.Jun 9 2016, 5:09 PM

Change 292974 merged by jenkins-bot:
Add script to remove orphaned event rows

https://gerrit.wikimedia.org/r/292974

ReleaseTaggerBot added a project: MW-1.28-release (WMF-deploy-2016-06-14_(1.28.0-wmf.6)).Jun 9 2016, 6:00 PM
Stashbot subscribed.Jun 21 2016, 1:11 PM

Mentioned in SAL [2016-06-21T13:11:28Z] <RoanKattouw> Running extensions/Echo/maintenance/removeOrphanedEvents.php on all Echo-enabled wikis for T136425

Catrope added a comment.Jun 21 2016, 10:38 PM
In T136425#2396242, @Stashbot wrote:

Mentioned in SAL [2016-06-21T13:11:28Z] <RoanKattouw> Running extensions/Echo/maintenance/removeOrphanedEvents.php on all Echo-enabled wikis for T136425

This is now done. It took 8 hours and 50 minutes. I didn't get a count of how many rows it removed, but across all wikis combined it's certainly over 100M.

Catrope closed this task as Resolved.Jun 21 2016, 10:38 PM
Catrope claimed this task.
Catrope mentioned this in T217073: Clean up orphaned echo_event rows again.Feb 25 2019, 6:51 PM
Catrope mentioned this in T308084: Reduce DB space used by Echo notifications.May 12 2022, 5:31 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits