Below QA covered 5 tools under user menu: talk,
sandbox, preferences, beta, contribution, logout. We also QAed watchlist , which was under the user menu before and later has been moved out. (T289619)

By wiki

User menu on top

Confirmed that the clicks on tools on top with vector-2022 skin increased since 2022-03-31.
Fig 1 clicks on tools on top of the page by wikis from logged-in users with vector-2022 skin

User menu on sticky header

Confirmed that the clicks on tools on sticky header with vector-2022 skin increased since 2022-03-31.
Fig 2 clicks on tools on sticky header by wikis from logged-in users with vector-2022 skin

By tool

User menu on top

Trend of user link clicks on top:

• Clicks on all tool links (expect watchlist) increased 132% in average since 2022-03-31
• Clicks on logout, my contribution, preference increased significantly, more than 100%.
• Clicks on watchlist dropped since 2022-03-11. Need to check the event tracking for clicks on watchlist.

Fig 3 clicks on tools on top of the page by tool type from logged-in users on all pilot wikis

Table 1 Clicks by tools on the top of the page before and after the fix

Pre period: 2022-03-17 ~ 2022-03-30
Post period: 2022-04-01 ~ 2022-04-14

User menu on sticky header

Trend of user link clicks on sticky header

• The number of clicks on tools on sticky header is much smaller than that of user menu on top.
• Clicks on all tool links increased after fix, 166.5 % in average.
• Among all tool links, logout, my contribution, mytalk, sandbox and watchlist increased significantly, more than 100%.

Fig 4 clicks on tools on the sticky header by tool type from logged-in users on all pilot wikis

Table 2 Clicks by tools on sticky header before and after the fix

Pre period: 2022-03-17 ~ 2022-03-30
Post period: 2022-04-01 ~ 2022-04-14

@jwang - in February, we moved the watchlist out of the user menu (https://phabricator.wikimedia.org/T289619) - I wonder if that is affecting the way it's being tracked

@ovasileva, that's my hypothesis too.

in February, we moved the watchlist out of the user menu (https://phabricator.wikimedia.org/T289619) - I wonder if that is affecting the way it's being tracked

Clicks on watchlist dropped since 2022-03-11. Need to check the event tracking for clicks on watchlist.

The events of the watchlist was tracked by event.name='pt-watchlist' before. Now it was tracked by event.name='pt-watchlist-2' after it was moved out of the user menu on top. (T289619).