Page MenuHomePhabricator

Pull data on watchlist star usage
Closed, ResolvedPublic

Description

Goal

We want to decide which icon to show to users: the watchlist star icon or the reading list icon. To inform this decision, we aim to understand how users interact with the watchlist star on both desktop and mobile web.

Accepted criteria

Usage of watchstar icon for desktop and mobile on enwiki

  • Number of watch vs unwatch actions
  • Percentage of unique sessions that clicked watchstar out of all sessions
  • Average number of watchstar clicks per session
  • Breakdown by edits count bucket

Event Timeline

HFan-WMF triaged this task as Medium priority.
HFan-WMF moved this task from Incoming to Ready for sprint on the Reader Experience Team board.

Following the instrumentation info that @Jdlrobson-WMF mentioned in T401972#11096518, I didn’t find the event from logged-in users on enwiki in web_ui_actions schema. Instead, I only see menu.watch events from logged-out users on mobile web. Could anyone confirm whether the instrumentation is enabled as expected?

The query

query = '''
SELECT performer.edit_count_bucket, agent.client_platform_family ,   CAST( performer.is_logged_in AS string) AS is_logged_in  , action_source, count(1) AS clicks, COUNT(DISTINCT performer.session_id) AS sessions
FROM event.mediawiki_web_ui_actions 
WHERE year=2025
AND action_source IN ( 'ca-watch', 'ca-unwatch', 'menu.watch', 'menu.unwatch')
AND mediawiki.`database`='enwiki'
GROUP BY performer.edit_count_bucket, agent.client_platform_family ,performer.is_logged_in, action_source
'''

Result

edit_count_bucketclient_platform_familyis_logged_inaction_sourceclickssessions
Nonemobile_browserFALSEmenu.watch2642121234

Change #1194747 had a related patch set uploaded (by Jdlrobson; author: Jdlrobson):

[mediawiki/core@master] Enable instrumentation of watchstar

https://gerrit.wikimedia.org/r/1194747

Bad news :-(! There is a bug which stops the watchstar being instrumented (above patch will fix it) which blocks this analysis.

Change #1194998 had a related patch set uploaded (by Jdlrobson; author: Jdlrobson):

[mediawiki/extensions/WikimediaEvents@master] Enable instrumentation of watchstar and other links that stopPropagation

https://gerrit.wikimedia.org/r/1194998

Change #1194747 abandoned by Jdlrobson:

[mediawiki/core@master] Enable instrumentation of watchstar

Reason:

https://gerrit.wikimedia.org/r/c/mediawiki/extensions/WikimediaEvents/+/1194998

https://gerrit.wikimedia.org/r/1194747

Change #1194998 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Enable instrumentation of watchstar and other links that stopPropagation

https://gerrit.wikimedia.org/r/1194998

Change #1195049 had a related patch set uploaded (by Jdlrobson; author: Jdlrobson):

[mediawiki/extensions/WikimediaEvents@wmf/1.45.0-wmf.22] Enable instrumentation of watchstar and other links that stopPropagation

https://gerrit.wikimedia.org/r/1195049

Change #1195049 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@wmf/1.45.0-wmf.22] Enable instrumentation of watchstar and other links that stopPropagation

https://gerrit.wikimedia.org/r/1195049

Mentioned in SAL (#wikimedia-operations) [2025-10-09T21:22:56Z] <jdlrobson@deploy2002> Started scap sync-world: Backport for [[gerrit:1195049|Enable instrumentation of watchstar and other links that stopPropagation (T406390)]]

Mentioned in SAL (#wikimedia-operations) [2025-10-09T21:47:54Z] <jdlrobson@deploy2002> jdlrobson: Backport for [[gerrit:1195049|Enable instrumentation of watchstar and other links that stopPropagation (T406390)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Mentioned in SAL (#wikimedia-operations) [2025-10-09T22:04:06Z] <jdlrobson@deploy2002> Finished scap sync-world: Backport for [[gerrit:1195049|Enable instrumentation of watchstar and other links that stopPropagation (T406390)]] (duration: 41m 38s)

I have verified the events in the event.mediawiki_web_ui_actions schema. Here’s a summary:

  • We started receiving events for 'ca-watch', 'ca-unwatch', 'menu.watch', and 'menu.unwatch' on Oct. 10.
  • Events are being received from logged-in users on both mobile web and desktop.
  • On enwiki, the average daily click event count is below 50, generated by fewer than 20 sessions. (sample rate 1%) I recommend starting the analysis after we’ve accumulated more data.
  • Events are fired from both the article pages (namespace = 0) and the talk pages (namespace = 1). cc @HFan-WMF

The following analysis is based on data collected from English Wikipedia over a three-week period (October 11–31, 2025). The data represents a 1% sample of English Wikipedia traffic.

1. Number of watch vs unwatch actions

platformwatch clicksunwatch clickswatch : unwatch
desktop browser1,2911459:1
mobile browser1,0685320:1

2. Percentage of unique sessions that clicked watchstar out of all sessions : desktop : 1.41%, mobile: 1.02%
3. Average number of watchstar clicks per session: desktop 7.1, mobile: 5.1
Note: We found five mobile or desktop sessions with over 100 clicks in a day, which might be inflating the average clicks per session.

client_platform_familyTotal sessionsclicks to watch or unwatchclicked sessionsclicked sessions%clicks per sessions
desktop_browser1437114362031.41%7.1
mobile_browser2153911212201.02%5.1

4. Breakdown by edits count bucket : The 1000+ edits bucket shows the highest clicked session rate.
Desktop

edit_count_buckettotal_sessionsclicks to watch and unwatchclicked sessionsclicked sessions%
0 edits4011230350.87%
1-4 edits1898228120.63%
5-99 edits388065310.80%
100-999 edits229453231.00%
1000+ edits24788601024.12%

Mobile Web

edit_count_buckettotal_sessionsclicks to watch and unwatchclicked sessionsclicked sessions%
0 edits4547236841.85%
1-4 edits3185396300.94%
5-99 edits7129351480.67%
100-999 edits381750210.55%
1000+ edits294188371.26%

5. Breakdown by edits count bucket :The majority of clicks are from article pages.

client_platform_familypage_typeclicks (watch + unwatch)
desktopArticle_page1271
Article_talk_page19
Others146
mobile webArticle_page1031
Article_talk_page9
Others81