Page MenuHomePhabricator

MinT for Readers instrumentation: user clicks to review and translate
Closed, ResolvedPublic2 Estimated Story Points

Description

At various stages, there is an option for users to review, edit and publish the automatic translation. When users click to review, they will be redirected to the Content Translation tool. This requires an event to be logged at MinT for Readers, and also at CX.

At MinT for Readers

action: click
action_subtype: review_translation
action_source:
 automatic_translation_menu
 review_translation_card

If there are more points where this option is shown, we can add them to sources.

At CX

Currently, this is being logged as

event_type: 
 dashboard_open
 dashboard_translation_start
event_source: direct_preselect

I suggest we change the source to preselect_mint_for_readers to be able to distinguish users coming from the feature.

Event Timeline

PWaigi-WMF raised the priority of this task from Medium to High.Mar 3 2025, 11:35 AM
Nikerabbit set the point value for this task to 4.Mar 3 2025, 12:47 PM

Both of these entrypoints, currently open the dialog that introduces the user to CX (T364129: Show an introduction before directing the user to Content Translation from MinT for Wikipedia Readers). Should we log the event when the user clicks on the "Correct and add to the article" button or when that dialog opens?

Change #1125621 had a related patch set uploaded (by Abijeet Patro; author: Abijeet Patro):

[mediawiki/extensions/ContentTranslation@master] AX Instrumentation: Log review_translation event

https://gerrit.wikimedia.org/r/1125621

Change #1125622 had a related patch set uploaded (by Abijeet Patro; author: Abijeet Patro):

[mediawiki/extensions/ContentTranslation@master] AX Instrumentation: Add preselect_mint_for_readers CX campaign

https://gerrit.wikimedia.org/r/1125622

abi_ changed the point value for this task from 4 to 2.

Both of these entrypoints, currently open the dialog that introduces the user to CX (T364129: Show an introduction before directing the user to Content Translation from MinT for Wikipedia Readers). Should we log the event when the user clicks on the "Correct and add to the article" button or when that dialog opens?

Yes, we should. I was not aware of this step. Let me check the workflow again.

This workflow on Figma doesn't seem to have this step. But from the description on the ticket, I assume this is what will happen, please correct if I am wrong.

  • user has two places where they can review the automatic translation
    • at the beginning of the article, "Review the automatic translation" card
    • from the Automatic translation menu, "Correct the translation" button

at both the steps, the "Review and fix translations" dialog will be shown to the user, and subsequently the user can click to review (which redirects them to CX) or close the prompt. Based on the above described flow, the events can be the following:

users click to review the translation
source will vary based on where the action is taken from

action: click
action_subtype: review_translation
action_source:
 automatic_translation_menu
 review_translation_card

from review translation dialog, user proceeds to review or close and go back

action: click
action_subtype: 
 accept_review_translation
 reject_review_translation
action_source: review_translation_dialog

If we log the accept/reject events, I don't think a separate event is needed when dialog opens.

abi_ changed the task status from Open to In Progress.Mar 11 2025, 11:32 AM

Change #1125621 merged by jenkins-bot:

[mediawiki/extensions/ContentTranslation@master] AX Instrumentation: Log events related to reviewing translations

https://gerrit.wikimedia.org/r/1125621

Change #1125622 merged by jenkins-bot:

[mediawiki/extensions/ContentTranslation@master] AX Instrumentation: Add preselect_mint_for_readers CX campaign

https://gerrit.wikimedia.org/r/1125622

Change #1128494 had a related patch set uploaded (by Eamedina; author: Eamedina):

[mediawiki/extensions/ContentTranslation@master] CX3 Build 1.0.0+20250317

https://gerrit.wikimedia.org/r/1128494

Change #1128494 merged by jenkins-bot:

[mediawiki/extensions/ContentTranslation@master] CX3 Build 1.0.0+20250317

https://gerrit.wikimedia.org/r/1128494

This is deployed on: https://language-cx.wmcloud.org/index.php/Special:AutomaticTranslation

To enable display of event logs in the web browser, paste the following into the browser console:

mw.loader.using('mediawiki.api')
    .then(
        () => new mw.Api().saveOption('eventlogging-display-web', '1')
    );

Pertinent comments: https://phabricator.wikimedia.org/T386682#10617845

Interactions with the review translation dialog within MinT for Readers

opens to review translation (review translation card) ✅

Screenshot from 2025-03-28 22-10-06.png (246×525 px, 52 KB)

opens to review translation (automatic translation) ✅

Screenshot from 2025-03-28 22-17-17.png (286×524 px, 65 KB)

accepts to review translation ✅

Screenshot from 2025-03-28 22-11-05.png (259×500 px, 49 KB)

rejects to review translation ✅

Screenshot from 2025-03-28 22-12-13.png (281×494 px, 58 KB)


At CX

Screenshot from 2025-03-28 22-11-55.png (705×514 px, 148 KB)

The events are being logged fine, but it seems like duplicate events are being logged. I tried a few times, and at both times, the events are being logged twice. Both are dashboard_open. Usually from an external point, one of the events should be dashboard_translation_start


At CX

Screenshot from 2025-03-28 22-11-55.png (705×514 px, 148 KB)

The events are being logged fine, but it seems like duplicate events are being logged. I tried a few times, and at both times, the events are being logged twice. Both are dashboard_open. Usually from an external point, one of the events should be dashboard_translation_start

I created T391256: Event Logging: dashboard_open event is triggered multiple times to track this.