Page MenuHomePhabricator

Create or update instrumentation to pull baseline data for Watchlist in iOS app
Closed, ResolvedPublic

Description

Background
For the upcoming iOS watchlist feature, we will need to track metrics within the feature to ensure it is a success. Some of this metrics include but are not limited to things like: number of visitors to the watchlist, duration of visit and components interacted with. This task basically encompasses putting together the correct instrumentations based on appropriate event triggers to gather such information.

The task

  • Instrumentation to answer the question: How often are people clicking items in All Articles vs Reading List tab in iOS app? Bonus points if we have distribution of events in all articles vs reading list tab. From T334215 - Task complete see T335547
  • Instrumentation to answer the question: What is the monthly average edit rate in Northern and Western Europe and North America (US and Canada)? - released on 7.3.0 - T313561
  • Instrumentation to measure initial clicks/engagement with Article Talk and User Talk page links in ios_talk_page_interactions to answer the question: How often are users leaving the app to view contributions page? See https://phabricator.wikimedia.org/T334215#8846437 NOTE TO ENGINEERS :) this is the ticket for the engineers

Requirements
Instrument our existing features to answer the questions in T334215. If it will take longer than 2-3 weeks to instrument, notify Rebecca so we can cut the scope as necessary. We want to start having data come in within 3 weeks at the latest.

Reference
This task

Event Timeline

RWambua-WMF renamed this task from Wire up instrumentation for the feature to Create or update instrumentation to pull baseline data for Watchlist in iOS app.May 1 2023, 7:14 PM
RWambua-WMF triaged this task as Medium priority.
RWambua-WMF updated the task description. (Show Details)
RWambua-WMF updated the task description. (Show Details)
RWambua-WMF lowered the priority of this task from Medium to Low.May 8 2023, 8:13 PM

Added item above:
We are not currently tracking actual clicks on Article Talk or User Talk page links in the ios_talk_page_interaction schema, but we do track deeper interactions with Article Talk and User Talk pages (action: open_topic, new_topic_click, reply_click, refresh, lang_change and submit) coming from the following sources (source: talk_page, article, deep_link, notifications_center,account, search, in_app_web_view and unknown) See: T321841#8387540.

We will need to add tracking/instrumentation for action = open_article_talk and open_user_talk with source dependent on where Talk Page links users are opening links (ie About this article -> View Talk page, User talk page links in diff view, Talk page views, links in Edit History diff views)

RWambua-WMF raised the priority of this task from Low to Medium.May 24 2023, 9:24 PM
Tsevener subscribed.

Engineering notes for 3rd checkbox:

Add an open_talk action, to be logged whenever we instantiate and push on a new TalkPageViewController (search TalkPageViewController( in the project to see four different areas this occurs in). The goal is to get this event logging whenever a tap navigates to a talk page.

Plan changed - New thing we need in 7.3.1 for baseline data is whenever a user taps "Contributions" on a user talk page overflow menu:

{F37129874}

Log as new overflow_contributions action in the ios_talk_page_interaction schema.

Change 936048 had a related patch set uploaded (by Mazevedo; author: Mazevedo):

[schemas/event/secondary@master] Add new property to ios_talk_page_interaction schema

https://gerrit.wikimedia.org/r/936048

Change 936048 merged by jenkins-bot:

[schemas/event/secondary@master] Add new property to ios_talk_page_interaction schema

https://gerrit.wikimedia.org/r/936048

New overflow_contributions action is available to test in TestFlight 7.3.1 (2331).

Tsevener updated the task description. (Show Details)
Tsevener added a subscriber: Mazevedo.

Verifying we are seeing events for overflow_contributions action in the ios_talk_page_interaction schema.

@JTannerWMF - We can directly track undo and rollback events that originate from editors visiting Diff pages through the Watchlist in-app event data - and we could track more of these events using Mediawiki_history data if we want to add an event_comment value to these specific edits (Similar to how we track suggested edits and plan to add more specific comments for those edits (See T347431: Reconfigure Suggested Edits event_comment values sent with edits).

Note: Spun off a ticket for this for iOS engineers: https://phabricator.wikimedia.org/T348201

The original KRs have no mention of moderation events, just feature engagement, let's discuss revamping the KRs for this project and including moderator tasks as a datapoint to track in our next meeting.