QA pin and unpin page tool

Issue for discussion and investigation

We observed more events of unpin (event.name=‘pinnable-header.vector-page-tools.unpin’) than events of pin (‘event.name=pinnable-header.vector-page-tools.pin’). In theory, it should be the opposite if tools in dropdown menu is the default. Is it possible the event names are reversed? If not, what else can be the cause?

Instrumentation

The click on move to sidebar is to pin the page tool at the right sidebar, supposed to be logged with event.name=‘pinnable-header.vector-page-tools.pin’ in event.desktopwebuiactionstracking schema.

Tha clicks on hide is to unpin the page tool, supposed to be logged with event.name= ‘pinnable-header.vector-page-tools.unpin’ in event.desktopwebuiactionstracking schema.

Data

Daily clicks to pin/unpin the page tool

Daily unique sessions which pin/unpin the page tool

Query

query_daily_pin <- "
SELECT TO_DATE(meta.dt) AS event_date,  event.name AS event_name, event.isAnon AS is_anon, COUNT(DISTINCT event.token) AS event_tokens, count(1) AS clicks
FROM event.desktopwebuiactionstracking
WHERe year=2023
AND event.action='click'
AND  event.name IN (
-- To pin the page tool to the right sidebar
'pinnable-header.vector-page-tools.pin' ,
-- To unpin the page tool
 'pinnable-header.vector-page-tools.unpin'
) 
GROUP BY TO_DATE(meta.dt) ,  event.name ,  event.isAnon
"

QA clicks on tool links

Instrumentation Note

The events will be logged in desktopwebuiactionstracking schema with below field value for each scenario.

QA summary

• The tool links which have logged events are marked with ✅ in below table
• Clicks on Who Wrote That are not logged in schema, marked with ❓ in below table. Needs to confirm with WEB team.
• The tool links under In other projects DON'T have click events logged in schema. The links are Wikimedia Commons,Wikibooks,Wikinews,Wikiquote,Wikisource,Wikiversity,Wikivoyage. Have confirmed with @ovasileva, it's OK that page tool analysis does not cover the events from other projects.

QA breakdown dimensions for tool link click events

QA Summary

Potential Issues/Limitations

• Unexpected events of clicks on old tool links (on left sidebar) from anonymous users in vector-2022 skin.

Old tool links are supposed to be only available in vector skin not vector-2022 skin. Now we received events of clicks on old tool links from both vector and vector-2022 skin by anonymous users, . These events occurred on all types of tool links located on the left sidebar.

Below table shows the number of click events from anonymous users on English WIkipedia by skin and link name

Daily trend of clicks on old tool links (on left sidebar) on English Wikipedia

Query

query_enwiki_anon <- "
SELECT event.skin , event.isAnon AS is_anon,  event.name, 
COUNT(DISTINCT event.token) AS event_tokens, count(1) AS clicks
FROM event.desktopwebuiactionstracking
WHERe year=2023
AND event.action='click'
AND event.name IN 
(
't-whatlinkshere',
't-recentchangeslinked',
't-specialpages',
't-permalink-page-tools',
't-info',
't-cite',
't-wikibase',
't-whowrotethat',
'ca-delete',
'ca-move',
'ca-unprotect',
'coll-download-as-rl',
't-print'
)
AND wiki='enwiki'  AND event.isAnon  
GROUP BY event.skin , event.isAnon, event.name
ORDER BY event.skin
LIMIT 10000
"

*Note
Logged-in users had the similar issue before but it has been fixed. There were events logged for clicks on old tool links in vector-2022 skin by logged-in users between 2023-01-18 and 2023-02-18. Data has been clean since 2023-02-19. Since then, events for old tool links have been only logged for vector skin. For future analysis, we should exclude the data between 2023-01-18 and 2023-02-18.

Have discussed the data trends of pin and unpin events (mentioned in T322204#8684502) with engineer. The pinned tool bar is the default in vector2022 as of March 2023. Therefore, it's expected to have more events of unpin (event.name=‘pinnable-header.vector-page-tools.unpin’) than events of pin (‘event.name=pinnable-header.vector-page-tools.pin’). It's not an issue.

QA breakdown dimensions for pin/unpin events

QA Summary

[1] Note:
There is one event logged for anonymous users from enwiki on 2023-01-28, logged as dt: 2023-01-28T18:16:08.593Z "isanon":true,"editcountbucket":"1-4 edits". It should be a wrong data entry as anonymous users should be in 0 edits bucket. We will exclude it in future analysis.

In T322204#8700531, @jwang wrote:

QA clicks on tool links

QA summary

• Clicks on Who Wrote That are not logged in schema, marked with ❓ in below table. Needs to confirm with WEB team.

Per discussion with engineer, Who Wrote That is part of browser extension. It's ok not to log.

After conducting QA, it seems page tools links are firing slightly incorrect syntax in production.

Example: On clicking the "Download as PDF" link in the right sidebar (when Page Tools is pinned), the following event fires: event.action="coll-download-as-rl.unknown.pinned"

The TOC version of this bug has been documented in T332612. Page tools should probably be addressed alongside TOC. cc: @Jdrewniak