Page MenuHomePhabricator
Create Task
Maniphest T393705

Remove CXStats related code
Closed, ResolvedPublic4 Estimated Story Points
Actions

Description

As a follow-up to T392839: CX tables miss a lot of important indexes causing partial outages. The CXStats page cannot be restored as is due to slow queries. It might get replaced with T365813: Develop a unified Content Translation (CX) metrics dashboard.

Details

Due Date
Jun 29 2025, 9:00 PM
Related Changes in Gerrit:
SubjectRepoBranchLines +/-
Update cxserver to 2025-08-14-134810-productionoperations/deployment-chartsmaster+1 -1
CxStats: Remove queries previously used by the stats pagemediawiki/extensions/ContentTranslationmaster+0 -167
Remove instance of `cxstats` from extension.jsonmediawiki/extensions/ContentTranslationmaster+0 -1
Remove unused script: compact-section-title-db.pymediawiki/services/cxservermaster+0 -147
Remove cxstats campaignoperations/mediawiki-configmaster+0 -6
CXStats: Remove instances of ContentTranslationStatsmediawiki/services/cxservermaster+1 -132
CX: Remove CXStats related codemediawiki/extensions/ContentTranslationmaster+1 -11 K
Customize query in gerrit

Related Objects

Event Timeline

Nikerabbit created this task.May 8 2025, 1:32 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 8 2025, 1:32 PM
Nikerabbit set Due Date to Jun 29 2025, 9:00 PM.May 8 2025, 1:33 PM
Nikerabbit added a project: LPL Essential (LPL Essential 2025 Apr-Jun: CX).May 22 2025, 6:26 AM
abi_ triaged this task as Medium priority.May 22 2025, 11:31 AM
abi_ moved this task from Needs Triage to Maintenance on the ContentTranslation board.
abi_ mentioned this in T392839: CX tables miss a lot of important indexes causing partial outages.May 27 2025, 9:56 AM
Nikerabbit moved this task from Backlog to Ready for dev on the LPL Essential (LPL Essential 2025 Apr-Jun: CX) board.Jun 2 2025, 6:50 AM
Nikerabbit set the point value for this task to 4.
Wangombe changed the task status from Open to In Progress.Jun 9 2025, 8:29 AM
Wangombe moved this task from Ready for dev to In Progress on the LPL Essential (LPL Essential 2025 Apr-Jun: CX) board.
gerritbot added a comment.Jun 9 2025, 4:01 PM

Change #1154848 had a related patch set uploaded (by Wangombe; author: Wangombe):

[mediawiki/extensions/ContentTranslation@master] CX: Remove CXStats related code

https://gerrit.wikimedia.org/r/1154848

gerritbot added a project: Patch-For-Review.Jun 9 2025, 4:01 PM
Wangombe claimed this task.Jun 9 2025, 4:02 PM
Wangombe added a subscriber: santhosh.Jun 23 2025, 8:28 AM

@santhosh A final round of review from you would be helpful before merging this change. Some API classes like includes/ActionApi/ApiQueryContentTranslationStats.php and includes/ActionApi/ApiQueryContentTranslationLanguageTrend.php have been removed along with some consumers of these APIs. If anything about this stands out to you, please share your thoughts.

santhosh added a comment.Jun 24 2025, 4:54 AM

@Wangombe , I reviewed it and proposed some changes

gerritbot added a comment.Jun 24 2025, 2:10 PM

Change #1163373 had a related patch set uploaded (by Wangombe; author: Wangombe):

[mediawiki/services/cxserver@master] Remove instances of ContentTranslationStats

https://gerrit.wikimedia.org/r/1163373

gerritbot added a comment.Jun 24 2025, 3:26 PM

Change #1154848 merged by jenkins-bot:

[mediawiki/extensions/ContentTranslation@master] CX: Remove CXStats related code

https://gerrit.wikimedia.org/r/1154848

ReleaseTaggerBot added a project: MW-1.45-notes (1.45.0-wmf.8; 2025-07-01).Jun 24 2025, 6:01 PM
gerritbot added a comment.Jun 25 2025, 12:21 PM

Change #1163373 merged by jenkins-bot:

[mediawiki/services/cxserver@master] CXStats: Remove instances of ContentTranslationStats

https://gerrit.wikimedia.org/r/1163373

Maintenance_bot removed a project: Patch-For-Review.Jun 25 2025, 12:30 PM
Nikerabbit added a comment.Jun 25 2025, 3:03 PM

I think we can also clean up the cxstats campaign config: https://codesearch.wmcloud.org/search/?q=cxstats&files=&excludeFiles=&repos=

Nikerabbit added a comment.Jun 25 2025, 3:17 PM

Also please remove the problematic queries that were only used by the stats page. E.g. Translation::getDeletionTrend and ::getStats, Translator::getStats, getTranslatorsCount, getTotalTranslatorsCount

And there is one more usage in cxserver, not sure if it was discussed already: https://gerrit.wikimedia.org/g/mediawiki/services/cxserver/+/96a8959c9cf25c3718c7e475865056d7041dddc8/scripts/compact-section-titles-db.py#32

abi_ moved this task from In Progress to Pending Deployment on the LPL Essential (LPL Essential 2025 Apr-Jun: CX) board.Jun 27 2025, 8:01 AM
abi_ moved this task from Pending Deployment to In Progress on the LPL Essential (LPL Essential 2025 Apr-Jun: CX) board.
Nikerabbit added a comment.Jun 30 2025, 8:24 AM

And there is one more usage in cxserver, not sure if it was discussed already: https://gerrit.wikimedia.org/g/mediawiki/services/cxserver/+/96a8959c9cf25c3718c7e475865056d7041dddc8/scripts/compact-section-titles-db.py#32

This script can also be removed. We need to come up with an alternative separately.

gerritbot added a comment.Jun 30 2025, 8:26 AM

Change #1164948 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/mediawiki-config@master] Remove cxstats campaign

https://gerrit.wikimedia.org/r/1164948

gerritbot added a project: Patch-For-Review.Jun 30 2025, 8:26 AM
gerritbot added a comment.Jul 1 2025, 7:01 AM

Change #1164948 merged by jenkins-bot:

[operations/mediawiki-config@master] Remove cxstats campaign

https://gerrit.wikimedia.org/r/1164948

Stashbot added a comment.Jul 1 2025, 7:02 AM

Mentioned in SAL (#wikimedia-operations) [2025-07-01T07:02:26Z] <kartik@deploy1003> Started scap sync-world: Backport for [[gerrit:1164948|Remove cxstats campaign (T393705)]]

Stashbot added a comment.Jul 1 2025, 7:06 AM

Mentioned in SAL (#wikimedia-operations) [2025-07-01T07:06:30Z] <kartik@deploy1003> kartik: Backport for [[gerrit:1164948|Remove cxstats campaign (T393705)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Stashbot added a comment.Jul 1 2025, 7:16 AM

Mentioned in SAL (#wikimedia-operations) [2025-07-01T07:16:44Z] <kartik@deploy1003> Finished scap sync-world: Backport for [[gerrit:1164948|Remove cxstats campaign (T393705)]] (duration: 14m 17s)

Maintenance_bot removed a project: Patch-For-Review.Jul 1 2025, 7:30 AM
gerritbot added a comment.Jul 2 2025, 8:17 AM

Change #1165820 had a related patch set uploaded (by Wangombe; author: Wangombe):

[mediawiki/services/cxserver@master] Remove unused script: compact-section-title-db.py

https://gerrit.wikimedia.org/r/1165820

gerritbot added a project: Patch-For-Review.Jul 2 2025, 8:17 AM
gerritbot added a comment.Jul 2 2025, 9:16 AM

Change #1165829 had a related patch set uploaded (by Wangombe; author: Wangombe):

[mediawiki/extensions/ContentTranslation@master] Remove instance of `cxstats` from extension.json

https://gerrit.wikimedia.org/r/1165829

gerritbot added a comment.Jul 2 2025, 11:58 AM

Change #1165820 merged by jenkins-bot:

[mediawiki/services/cxserver@master] Remove unused script: compact-section-title-db.py

https://gerrit.wikimedia.org/r/1165820

gerritbot added a comment.Jul 2 2025, 12:55 PM

Change #1165829 merged by jenkins-bot:

[mediawiki/extensions/ContentTranslation@master] Remove instance of `cxstats` from extension.json

https://gerrit.wikimedia.org/r/1165829

ReleaseTaggerBot edited projects, added MW-1.45-notes (1.45.0-wmf.9; 2025-07-08); removed MW-1.45-notes (1.45.0-wmf.8; 2025-07-01).Jul 2 2025, 1:00 PM
Maintenance_bot removed a project: Patch-For-Review.Jul 2 2025, 1:32 PM
gerritbot added a comment.Jul 3 2025, 6:46 AM

Change #1166069 had a related patch set uploaded (by Wangombe; author: Wangombe):

[mediawiki/extensions/ContentTranslation@master] CxStats: remove the problematic queries only used by the stats page

https://gerrit.wikimedia.org/r/1166069

gerritbot added a project: Patch-For-Review.Jul 3 2025, 6:46 AM
Wangombe added a comment.EditedJul 3 2025, 6:48 AM
In T393705#10947697, @Nikerabbit wrote:

Also please remove the problematic queries that were only used by the stats page. E.g. Translation::getDeletionTrend and ::getStats, Translator::getStats, getTranslatorsCount, getTotalTranslatorsCount

And there is one more usage in cxserver, not sure if it was discussed already: https://gerrit.wikimedia.org/g/mediawiki/services/cxserver/+/96a8959c9cf25c3718c7e475865056d7041dddc8/scripts/compact-section-titles-db.py#32

Addressed in https://gerrit.wikimedia.org/r/1166069

gerritbot added a comment.Jul 3 2025, 3:17 PM

Change #1166069 merged by jenkins-bot:

[mediawiki/extensions/ContentTranslation@master] CxStats: Remove queries previously used by the stats page

https://gerrit.wikimedia.org/r/1166069

Maintenance_bot removed a project: Patch-For-Review.Jul 3 2025, 3:30 PM
Nikerabbit moved this task from In Progress to Pending Deployment on the LPL Essential (LPL Essential 2025 Apr-Jun: CX) board.Jul 7 2025, 6:30 AM
Nikerabbit closed this task as Resolved.Jul 10 2025, 6:34 AM
Nikerabbit moved this task from Pending Deployment to Done on the LPL Essential (LPL Essential 2025 Apr-Jun: CX) board.
Nikerabbit added a subscriber: ngkountas.

Nothing to test. @ngkountas the query doc can be updated.

ngkountas added a comment.Jul 10 2025, 8:25 AM

CX query audit document is now up to date.

Wangombe mentioned this in T100035: Show users grouped by number of translations on Special:ContentTranslationStats.Aug 11 2025, 12:24 PM
gerritbot added a comment.Aug 16 2025, 12:37 PM

Change #1179243 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/deployment-charts@master] Update cxserver to 2025-08-14-134810-production

https://gerrit.wikimedia.org/r/1179243

gerritbot added a project: Patch-For-Review.Aug 16 2025, 12:37 PM
gerritbot added a comment.Aug 19 2025, 7:26 AM

Change #1179243 merged by jenkins-bot:

[operations/deployment-charts@master] Update cxserver to 2025-08-14-134810-production

https://gerrit.wikimedia.org/r/1179243

Maintenance_bot removed a project: Patch-For-Review.Aug 19 2025, 7:31 AM
Stashbot added a comment.Aug 19 2025, 7:33 AM

Mentioned in SAL (#wikimedia-operations) [2025-08-19T07:33:53Z] <kart_> Updated cxserver to 2025-08-14-134810-production (T399117, T393705)

Stashbot mentioned this in T399117: Support querying "easy" translation recommendations.Aug 19 2025, 7:33 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits