Page MenuHomePhabricator

Verify mobile language selector entry point instrumentation (QA)
Closed, ResolvedPublic

Description

As the initial entry point for Section Translation is implemented (T286645) and instrumented (T290428), we want to carefully check that we get the correct data. This is quite important since we want to make decisions based on reliable data.

In particular, as part of this ticket we want to:

  • @EChukwukere-WMF to check how the event is firing. The event console should show the event when users select the option to start a translation for a missing language (for all options provided either as language names or the "..." button). Steps (DRAFT):
    1. Go to the mobile Wikipedia page (such as Plants in Space)
    2. Use language switcher to search for a language where content is missing and section translation is available such as Bengali
    3. Click invite to translate to a different language
    4. Event should appear in Javascript Console
  • @MNeisler to check the aggregate data. Making sure data arrives, and the available data is complete.
  • Other aspects that data analyst or QA engineers consider relevant.

Documenting the results of the process will be helpful to reassure in the future that the data was correct when we tested it.

Event Timeline

Pginer-WMF created this task.

@Pginer-WMF where can I get the data from our test environments and production?

@Pginer-WMF where can I get the data from our test environments and production?

My ubnderstanding was that events should be visible from the Javascript console, but I see nothing by default. Maybe @MNeisler or @ngkountas know what is required for the events to be visible.

My understanding was that events should be visible from the Javascript console, but I see nothing by default. Maybe @MNeisler or @ngkountas know what is required for the events to be visible.

I believe these events should be visible in the Javascript console. @ngkountas Can you confirm what is required to see these events? I drafted a very rough outline of steps in the task description based on my understanding but please adjust as needed.

@MNeisler your draft steps are indeed very close to the actually needed ones. @EChukwukere-WMF in order to have the events shown up in the console you'll need:

  1. Activate event logging in target wiki (e.g. bn wiki) by running the following command in the console (inside the target wiki):
mw.loader.using( 'mediawiki.api' ).then( function () {
    new mw.Api().saveOption( 'eventlogging-display-web', '1' );
} );
  1. Visit an article in the source wiki (e.g. en wiki) like the one suggested in the description (Plants in Space)
  2. Click on the entrypoint to navigate to the Section Translation application inside the target wiki of the first step.
  3. Check the events that appear both inside the screen and inside the console.

The following screencast demonstrates the above steps (English/Greek wiki):
{F35244265}

QA PASS: see attached document

Pginer-WMF claimed this task.