Page MenuHomePhabricator

Post-deployment QA: Reply tool v2.0 instrumentation
Closed, ResolvedPublic

Description

T252924 added new fields to the the VisualEditorFeatureUse schema [1][2].

This task is about ensuring these newly added events and fields are firing correctly on production.

Events and fields to check

The events that need to be checked can be found in rows 81 through 133 of the "Reply V2.0" sheet of this workbook: Replying QC Template: Instrumentation and data checks.

Testing details

  • Wiki(s) where Version 2.0 of the Reply tool should be tested: Arabic, Dutch, French or Hungarian Wikipedia
  • Where to check to verify where the events and fields are firing correctly: browser console
  • Where to log the outcome of the event checks: the "Reply V2.0" sheet of the Replying QC Template: Instrumentation and data checks workbook.

Done

  • All "events" and "fields" specified in the instrumentation sheet have been verified as firing ("yes" / "no") and being logged ("yes" / "no")

  1. https://www.mediawiki.org/wiki/VisualEditor/FeatureUse_data_dictionary
  2. https://meta.wikimedia.org/wiki/Schema:VisualEditorFeatureUse

Event Timeline

Task description update
Making the following updates to the task description per chat with @Mayakp.wiki:

  • REMOVED: "Where to check to verify where the events and fields are being logged correctly: log file

The task description is updated with the following:

  • The events and fields that will need to be checked (this information can be found in the "Events and fields to check" section)
  • Where the results of these checks should be logged (this information can be found in the "Testing details" section)
  • The environment in which these events should be tested (this information can be found in the "Testing details" section)

Checked all the events listed in Replying QC Template: Instrumentation and data checks on Dutch Wikipedia. All of them are logging correctly.