Page MenuHomePhabricator

Limit the publication of fast unreviewed translations
Open, In Progress, MediumPublic

Description

Some campaigns/contests can result in spikes of translations where the user has not paid enough care to review their contents in order to get more content published. In order to emphasize quality over quantity we can consider to add a delay when users publish a large translation under a very short time before they can translate the next article. For example, after a user has translated a 10 paragraph article under 30 seconds, the tool can show a message indicating the user that a large amount of content was translated on a very short time and the tool will give the user 10 minutes to review and improve those contents before allowing to start a new translation.

Note that this is compatible with alternative workflows where users apply machine translation first to later edit the resulting article with Visual Editor. However, it would help to prevent sequence of massively generated articles without revision.

Proposed approach

This proposal only applies to the new unified dashboard that is currently present on mobile (and test wiki). The desktop dashboard for Content Translation will not be affected.

Logic

We want to make sure that users had enough time to review the content they published, providing a waiting period that is reasonable. The waiting period estimation considers 1 minute per paragraph up to 10 minutes. We consider only the translations published in the main namespace since other namespaces can be used for different testing purposes.

Given the last published translation for the user on the main namespace where N paragraphs were published, and it was started T minutes ago:

FormulaDetails
[For N ≤ 10] Ask to wait N minutes if T < N minutes.For articles with 10 paragraphs or less (N≤10) we want to make sure that users spent translating it at least N minutes (one minute per paragraph)
[For N > 10] Ask to wait 10 minutes if T < 10 minutesFor articles with more than 10 paragraphs (N>10) we want to make sure that users spent translating it at least 10 minutes.

Message

Review your last translation

After finishing a quick translation, you need to wait 10 min before initiating a new one. Please, review past work during this period, as high-quality content is valued by our editor community.

[Learn more]

[Close] [Review translation]

Workflow and interactions

Confirmation stepDialog showing the warning
Confirmation Step.png (568×320 px, 97 KB)
Confirmation Step - Too fast.png (568×320 px, 59 KB)
  • When the user is as the confirmation step, the main action (start a new translation or select a section) will trigger the warning message if the conditions are met.
  • "Review translation" will open the last published translation in a new window/tab.
  • "Close" will close the dialog (same as the "X" icon on top).
  • The "Learn more" link will point to a page from the documentation about this mechanism.

Event Timeline

UOzurumba renamed this task from Limit the publication of fast unreviewed translaitons to Limit the publication of fast unreviewed translations.Mar 2 2023, 2:58 PM
Nikerabbit moved this task from Needs Triage to MT on the ContentTranslation board.
ngkountas changed the task status from Open to In Progress.Feb 12 2024, 10:55 AM
ngkountas claimed this task.

Change 1009225 had a related patch set uploaded (by Nik Gkountas; author: Nik Gkountas):

[mediawiki/extensions/ContentTranslation@master] CX: Create endpoint to check for fast unreviewed recent translations

https://gerrit.wikimedia.org/r/1009225

Change 1009225 merged by jenkins-bot:

[mediawiki/extensions/ContentTranslation@master] CX: Create endpoint to check for fast unreviewed recent translations

https://gerrit.wikimedia.org/r/1009225

Change #1015533 had a related patch set uploaded (by Nik Gkountas; author: Nik Gkountas):

[mediawiki/extensions/ContentTranslation@master] CX: Add dialog to notify users about fast unreviewed translations

https://gerrit.wikimedia.org/r/1015533

@Pginer-WMF the message inside the dialog according to the task description says:

After finishing a quick translation, you need to wait 10 min before initiating a new one. Please, review past work during this period, as high-quality content is valued by our editor community.

[Learn more]

However, since the waiting time can vary (depending on the translated paragraphs), do you think we should update the message to reflect that? In other words, should the message be "After finishing a quick translation, you need to wait 5 min before initiating a new one", if the count of translated paragraphs for the fast unreviewed translations is 5?

@Pginer-WMF the message inside the dialog according to the task description says:

After finishing a quick translation, you need to wait 10 min before initiating a new one. Please, review past work during this period, as high-quality content is valued by our editor community.

[Learn more]

However, since the waiting time can vary (depending on the translated paragraphs), do you think we should update the message to reflect that? In other words, should the message be "After finishing a quick translation, you need to wait 5 min before initiating a new one", if the count of translated paragraphs for the fast unreviewed translations is 5?

I'm more inclined to communicate the standard 10min waiting time. That helps to set a simple rule in the user mind. If we show a different number of minutes every time it may not be clear why it changes and just feel random.

A possible alternative is to focus the messaging on the remaining number of minutes users have to wait. Would the following make sense from your perspective?

After finishing a quick translation, you need to wait some minutes before initiating a new one. Please, spend X more minutes reviewing your past work, as high-quality content is valued by our editor community.

(X would be number between 10 and 1, since rounding up would make sense in this context).