Page MenuHomePhabricator

Ensure Editing Team's use of DesktopWebUIActions schema will not interfere with Web Team's plans
Open, Needs TriagePublic

Description

T304035 and T304036 represent the work involved with verifying the DesktopWebUIActions schema is technically capable of tracking the data the Editing Team will need to complete the analyses we have planned to evaluate the impact of the Usability Improvements (T249579). [i]

This task involves the work with coordinating with the Web Team to ensure the Editing Team's use of the DesktopWebUIActions schema will not interfere with the Web Team's use of it.

Wikis impacted

@ppelberg to populate this section with the list of wikis where the Editing Team would need the DesktopWebUIActions schema's sampling rate to potentially be adjusted.

Wiki
TBD

Open Questions

  • 1. What – if any – concerns does the Web Team have about the Editing Team potentially adjusting the rate at which the DesktopWebUIActions schema samples events at the wikis listed in ===Wikis impacted section above? Note: context around the need to adjust the sampling rate can be found in T304035.
  • 2. What – if any – concerns does the Web Team have about the DesktopWebUIActions schema being enabled on all wikis? As the Editing Team currently understands, the DesktopWebUIActions is not yet available/enabled on all wikis.

Done

  • Answers to all ===Open questions are documented

i. Planned analyses:

Desktop AnalysesMobile Analyses
T302359 + T302358T298065 + T298062

Event Timeline

ppelberg updated the task description. (Show Details)
  1. What – if any – concerns does the Web Team have about the Editing Team potentially adjusting the rate at which the DesktopWebUIActions schema samples events at the wikis listed in ===Wikis impacted section above?

I'd be concerned about straining the infrastructure. The sampling rate is low as it is to intentionally avoid problems, however we do oversample for logged in users at 100% (using WMEDesktopWebUIActionsTrackingOversampleLoggedInUsers). I think you could similarly change the sampling rate on a per namespace basis, but please communicate with our analyst @jwang before and after any change.

Ideally any changes to the sampling rate would not impact article page views, as this is typically what we are monitoring during the desktop improvements project.

What – if any – concerns does the Web Team have about the DesktopWebUIActions schema being enabled on all wikis? As the Editing Team currently understands, the DesktopWebUIActions is not yet available/enabled on all wikis.

I think the only impact is that @jwang would need to adjust her queries to filter wikis, however I think she's doing that anyway. @jwang can you confirm?

Thanks for pinging me @Jdrobson.

We don't have ongoing experiment using DesktopWebUIActions schema now. The only impact is on the metric historical tracking. We can just note the change date in the graph or report if needed. Please keep us updated on the enable dates.