The schema that we want to implement is https://meta.wikimedia.org/wiki/Schema:Popups
The current questions proposed by the team to answer is: Can the decrease in pageviews in the presence of Hovercards be compensated by the number of Hovercards being used by users (readers/editors).
As part of this research Analytics will help UX to finalize 1 or more research questions to ask and to test for/verify via the data collected during the three month trial period. Analytics will also work with the team to make sure the schema is correct, and is capturing the right set of data.
This is the instrumentation that we are planning to implement.
Once we've made it default on a particular language wiki there can be two user groups:
A. People who'll disable it using the settings (within Hovercards, not MediaWiki preference)
B. People who'll continue to use Hovercards
The instrumentation for both would be the same barring a few
differenxes that I'll point out in the end. The schema will roughly be
- Unique session id
- Duration (in ms) for how long the hovercard was open
- Whether the hovercard or the link that was being hovered on was:
- Dismissed: The mouse left the area of the link/hovercard.
- Opened in New Tab: Command/Ctrl + Click or Scroll Click
- Opened in New Window: Shift + Click
- Opened in Same Window: Click
- Is hovercard enabled?
- The popup delay (default/value set by user/value set by wiki's common.js)
For user group A:
- Values (2) and (5) will not be logged.
- (3) will be logged for the links themselves as there will be no hovercard to show.
- Consequently, (3.1) will never be logged for A
We need to confirm that this will give us the data we need to validate the case for Hovercards