Page MenuHomePhabricator

QA ToC Instrumentation on Beta Cluster
Closed, DeclinedPublic

Description

Background

We have added the items required in the ToC instrumentation specification (https://docs.google.com/spreadsheets/d/1CAXGqV2JR_bE0ulo9EU3I74Jm0Ln9z1u2CjC6zvra7I/edit#gid=0) which will allow us to perform an A/B test on the new Table of Contents focused on answering the following questions:

  1. Is the new table of contents used more frequently than the previous table of contents?
  2. Does the new table of contents reduce the need to scroll back to the top of the page?
  3. Does the new table of contents decrease the time people spend scrolling/scrolling quickly (if possible)?
  4. How does the new table of contents affect the time spent on a page?

Acceptance criteria

Ensure all instrumentation is behaving as expected on the beta cluster (production QA will be tracked in T305442: QA ToC Instrumentation)

Event Timeline

ovasileva created this task.
ovasileva reassigned this task from Edtadros to jwang.
ovasileva added a subscriber: jwang.
ovasileva added a subscriber: Edtadros.

@ovasileva , Can you clarify what is beta cluster?

@ovasileva , based on the discussion on slack, event-logging is not enabled on beta cluster. I cannot perform schema query test.

Add @Ottomata, who is the expert of eventlogging, in case he know more details.

Hi, in beta, we do not manage infrastructure to allow querying of events in a database. It could be done, but our experience managing this kind of infra in beta was error prone and fragile.

You can use beta to produce and test that events are flowing in as expected. https://wikitech.wikimedia.org/w/index.php?title=Event_Platform/Instrumentation_How_To#In_beta

Discussed with @jwang - we will just skip to testing this directly in production in T305442: QA ToC Instrumentation

This comment was removed by jwang.