Page MenuHomePhabricator

Schema QA sticky header instrumentation
Closed, ResolvedPublic

Description

Background

This task will encompass the analyst QA for all instrumentation built for and user for the analysis of the sticky header A/B test.

Acceptance criteria

Schema QA the instrumentation built in the following tasks:

DONE

  • Schema QA : mediawiki_web_ui_scroll T297851
  • Schema QA : mediawiki_web_ab_test_enrollment T297852

Event Timeline

ovasileva triaged this task as High priority.
ovasileva created this task.
ovasileva moved this task from Incoming to Analyst Consultation on the Web-Team-Backlog board.
jwang renamed this task from QA sticky header instrumentation to Schema QA sticky header instrumentation.Nov 1 2021, 5:00 PM
jwang added a project: Product-Analytics.
jwang updated the task description. (Show Details)

@Edtadros, are the schemas ready for QA now? If so, could you confirm the schema names enabled by T292586 and T292587? I searched by key words "scroll" or "ab_test", etc.. I do not see the new schemas in event database yet.

@ovasileva , do we have instrumentation to track clicks on sticky header? (instrumentation spec)

@ovasileva , do we have instrumentation to track clicks on sticky header? (instrumentation spec)

@jwang - do we mean clicks to items within the sticky header? If so, yes, we should have that within the DesktopWebUIActionsTracking schema. Is it not appearing?

hi @ovasileva, @jwang -- I confirmed locally that sticky header events are logging to DesktopWebUIActionsTracking

And to double-check, I also ran a query to see if sticky header clicks are showing up in Hue and they are there too!

here's the query:

SELECT * FROM desktopwebuiactionstracking where year = '2022' AND event.action = 'click' AND event.skinversion = 2 AND event.name LIKE '%sticky%'

and here's a screenshot of the results (not alot since I limited to 2022 and iirc only 1/3 of users on test and/or office wikis see the sticky header):

Screen Shot 2022-01-04 at 12.20.15 PM.png (1×2 px, 500 KB)

so presumably we're gtg to deploy tomorrow to pilot wikis?

@cjming , thanks for the information.

I have completed instrumentations for sticky header. All looks working.

  • Schema QA : mediawiki_web_ui_scroll T297851
  • Schema QA : mediawiki_web_ab_test_enrollment T297852

hi @ovasileva, @jwang -- I confirmed locally that sticky header events are logging to DesktopWebUIActionsTracking

And to double-check, I also ran a query to see if sticky header clicks are showing up in Hue and they are there too!

here's the query:

SELECT * FROM desktopwebuiactionstracking where year = '2022' AND event.action = 'click' AND event.skinversion = 2 AND event.name LIKE '%sticky%'

and here's a screenshot of the results (not alot since I limited to 2022 and iirc only 1/3 of users on test and/or office wikis see the sticky header):

Screen Shot 2022-01-04 at 12.20.15 PM.png (1×2 px, 500 KB)

so presumably we're gtg to deploy tomorrow to pilot wikis?

Yes, we are! Thanks for checking @cjming!

Resolving this. Analysis should begin Jan 24