Page MenuHomePhabricator

Limit the publication of fast unreviewed translations
Closed, ResolvedPublic

Description

Some campaigns/contests can result in spikes of translations where the user has not paid enough care to review their contents in order to get more content published. In order to emphasize quality over quantity we can consider to add a delay when users publish a large translation under a very short time before they can translate the next article. For example, after a user has translated a 10 paragraph article under 30 seconds, the tool can show a message indicating the user that a large amount of content was translated on a very short time and the tool will give the user 10 minutes to review and improve those contents before allowing to start a new translation.

Note that this is compatible with alternative workflows where users apply machine translation first to later edit the resulting article with Visual Editor. However, it would help to prevent sequence of massively generated articles without revision.
For more details, you can check the user documentation.

Proposed approach

This proposal only applies to the new unified dashboard that is currently present on mobile (and test wiki). The desktop dashboard for Content Translation will not be affected.

Logic

We want to make sure that users had enough time to review the content they published, providing a waiting period that is reasonable. The waiting period estimation considers 1 minute per paragraph up to 10 minutes. We consider only the translations published in the main namespace since other namespaces can be used for different testing purposes.

Given the last published translation for the user on the main namespace where N paragraphs were published, and it was started T minutes ago:

FormulaDetails
[For N ≤ 10] Ask to wait N minutes if T < N minutes.For articles with 10 paragraphs or less (N≤10) we want to make sure that users spent translating it at least N minutes (one minute per paragraph)
[For N > 10] Ask to wait 10 minutes if T < 10 minutesFor articles with more than 10 paragraphs (N>10) we want to make sure that users spent translating it at least 10 minutes.

Message

Review your last translation

After finishing a quick translation, you need to wait 10 min before initiating a new one. Please, review past work during this period, as high-quality content is valued by our editor community.

[Learn more]

[Close] [Review translation]

Workflow and interactions

Confirmation stepDialog showing the warning
Confirmation Step.png (568×320 px, 97 KB)
Confirmation Step - Too fast.png (568×320 px, 59 KB)
  • When the user is as the confirmation step, the main action (start a new translation or select a section) will trigger the warning message if the conditions are met.
  • "Review translation" will open the last published translation in a new window/tab.
  • "Close" will close the dialog (same as the "X" icon on top).
  • The "Learn more" link will point to a page from the documentation about this mechanism.

Event Timeline

UOzurumba renamed this task from Limit the publication of fast unreviewed translaitons to Limit the publication of fast unreviewed translations.Mar 2 2023, 2:58 PM
Nikerabbit moved this task from Needs Triage to MT on the ContentTranslation board.
ngkountas changed the task status from Open to In Progress.Feb 12 2024, 10:55 AM
ngkountas claimed this task.

Change 1009225 had a related patch set uploaded (by Nik Gkountas; author: Nik Gkountas):

[mediawiki/extensions/ContentTranslation@master] CX: Create endpoint to check for fast unreviewed recent translations

https://gerrit.wikimedia.org/r/1009225

Change 1009225 merged by jenkins-bot:

[mediawiki/extensions/ContentTranslation@master] CX: Create endpoint to check for fast unreviewed recent translations

https://gerrit.wikimedia.org/r/1009225

Change #1015533 had a related patch set uploaded (by Nik Gkountas; author: Nik Gkountas):

[mediawiki/extensions/ContentTranslation@master] CX: Add dialog to notify users about fast unreviewed translations

https://gerrit.wikimedia.org/r/1015533

@Pginer-WMF the message inside the dialog according to the task description says:

After finishing a quick translation, you need to wait 10 min before initiating a new one. Please, review past work during this period, as high-quality content is valued by our editor community.

[Learn more]

However, since the waiting time can vary (depending on the translated paragraphs), do you think we should update the message to reflect that? In other words, should the message be "After finishing a quick translation, you need to wait 5 min before initiating a new one", if the count of translated paragraphs for the fast unreviewed translations is 5?

@Pginer-WMF the message inside the dialog according to the task description says:

After finishing a quick translation, you need to wait 10 min before initiating a new one. Please, review past work during this period, as high-quality content is valued by our editor community.

[Learn more]

However, since the waiting time can vary (depending on the translated paragraphs), do you think we should update the message to reflect that? In other words, should the message be "After finishing a quick translation, you need to wait 5 min before initiating a new one", if the count of translated paragraphs for the fast unreviewed translations is 5?

I'm more inclined to communicate the standard 10min waiting time. That helps to set a simple rule in the user mind. If we show a different number of minutes every time it may not be clear why it changes and just feel random.

A possible alternative is to focus the messaging on the remaining number of minutes users have to wait. Would the following make sense from your perspective?

After finishing a quick translation, you need to wait some minutes before initiating a new one. Please, spend X more minutes reviewing your past work, as high-quality content is valued by our editor community.

(X would be number between 10 and 1, since rounding up would make sense in this context).

Change #1015533 merged by jenkins-bot:

[mediawiki/extensions/ContentTranslation@master] CX: Add dialog to notify users about fast unreviewed translations

https://gerrit.wikimedia.org/r/1015533

Change #1055889 had a related patch set uploaded (by Nik Gkountas; author: Nik Gkountas):

[mediawiki/extensions/ContentTranslation@master] CX3 Build 0.2.0+20240722

https://gerrit.wikimedia.org/r/1055889

Change #1055889 merged by jenkins-bot:

[mediawiki/extensions/ContentTranslation@master] CX3 Build 0.2.0+20240722

https://gerrit.wikimedia.org/r/1055889

The dialog that blocks fast unreviewed translations shows up properly as demonstrated by the following screencast from greek (el) production wiki. NOTE: The dialog takes a while to show up, and we may need to add some kind of loading indicator. The loading time during the second time the dialog opens was cut off from the screencast and this is why it appears shorter. The actual time is much longer, like it is in the first time the "check unreviewed translation" dialog opens.

This task can be closed as done.