Page MenuHomePhabricator

Community-defined Translation Collections: Instrumentation
Open, HighPublic

Description

Background

By making collections visible in the existing translation workflow, where editors come to translate articles:
a) We hope to increase the visibility/discovery of topical gaps already being curated by organizers and communities -> If this works, we increase the chances that more editors become aware of these worklists.
b) We hope to increase quality content contributions through translations -> If this approach works, topical/campaign worklists can be a great, alternative source of translation suggestions for editors.

Description

As part of T368718, we want to add instrumentation to the collections interactions:
-> To understand translation patterns as they relate to collections
-> To view the outcomes of interactions with suggestions that fall under collections: select/filter, start, save, refresh, complete, or discard.
-> To view the outcomes of interactions with suggestions that are part of campaigns/wikiprojects/events/vital articles under collections: select/filter, start, save, refresh, complete, or discard.

User Story

As a product manager,
I want to know if translators start/filter, save, complete, refresh, complete, or discard translations under collections,
So that we can understand if this increases discoverability and # of translations.

As a product manager,
I want to know if translators reach for specific campaigns/wikiprojects/events/vital articles under collections,
So that we can understand editor preferences better.

Event Timeline

PWaigi-WMF triaged this task as Medium priority.Sep 3 2024, 7:53 AM
KCVelaga_WMF raised the priority of this task from Medium to High.Sep 17 2024, 7:27 AM
KCVelaga_WMF moved this task from Incoming to Engineering on the LPL Analytics board.
PWaigi-WMF renamed this task from Community-defined translation lists: Instrumentation to Community-defined Translation Collections: Instrumentation.Oct 31 2024, 2:55 PM

Change #1097435 had a related patch set uploaded (by Eamedina; author: Eamedina):

[mediawiki/extensions/ContentTranslation@master] Include appropriate event source for a collection filter selection

https://gerrit.wikimedia.org/r/1097435

Change #1097435 merged by jenkins-bot:

[mediawiki/extensions/ContentTranslation@master] Include appropriate event source for a collection filter selection

https://gerrit.wikimedia.org/r/1097435

Change #1094472 had a related patch set uploaded (by Nik Gkountas; author: Nik Gkountas):

[mediawiki/extensions/ContentTranslation@master] CX3 Build 0.2.0+20241122

https://gerrit.wikimedia.org/r/1094472

Change #1094472 merged by jenkins-bot:

[mediawiki/extensions/ContentTranslation@master] CX3 Build 0.2.0+20241125

https://gerrit.wikimedia.org/r/1094472

SBisson subscribed.

This has been deployed with the train this week.

@KCVelaga_WMF you can now verify that the events are correct.

I verified the events, the event triggered is fine.


  • I am not able to test actually selecting a collection and start a translation with it, as there were no collections listed. Is there a specific wiki on which I can test this on?
  • Additionally, similar to topic areas, the collection name needs to be captured with event_context - for example, "wiki-loves-science-2024" and in case if the user selects all collections, it can be simply "all-collections"
    • The same needs to be followed for the confirmation step. Currently, the event_context for suggestion_filters_confirm is being recorded for "collections" - this should instead be "all-collections" or the name of the collection.

Change #1099732 had a related patch set uploaded (by Eamedina; author: Eamedina):

[mediawiki/extensions/ContentTranslation@master] Instrumentation: Include event-context for collections event logging

https://gerrit.wikimedia.org/r/1099732

@KCVelaga_WMF thanks for the review.

test actually selecting a collection and start a translation with it, as there were no collections listed.

The collections update was deployed recently, can you try again? You should be able to see them now.

Additionally, similar to topic areas, the collection name needs to be captured with event_context - for example, "wiki-loves-science-2024" and in case if the user selects all collections, it can be simply "all-collections". The same needs to be followed for the confirmation step. Currently, the event_context for suggestion_filters_confirm is being recorded for "collections" - this should instead be "all-collections" or the name of the collection.

Addressed the missing event context with the patch above, currently under review

The collections update was deployed recently, can you try again? You should be able to see them now.

Yes! I am able to select and filter to collections. I will do a final QA once the event_context patch is also merged.

Also, I am wondering if a backport deployment can be done for that change.

Change #1099732 merged by jenkins-bot:

[mediawiki/extensions/ContentTranslation@master] Instrumentation: Include event-context for collections event logging

https://gerrit.wikimedia.org/r/1099732

Change #1099753 had a related patch set uploaded (by Nik Gkountas; author: Nik Gkountas):

[mediawiki/extensions/ContentTranslation@master] CX3 Build 0.2.0+20241202

https://gerrit.wikimedia.org/r/1099753

Change #1099753 merged by jenkins-bot:

[mediawiki/extensions/ContentTranslation@master] CX3 Build 0.2.0+20241202

https://gerrit.wikimedia.org/r/1099753

@KCVelaga_WMF The follow up for event_context for collections was deployed with the train this week. You may now verify this again. Thanks!

QA done. Looks good to me.

From the logs,

event_contextcount
Wiki99/food4
Vital articles4
Women's Health3
Essential Articles3
all-collections3