Page MenuHomePhabricator
Create Task
Maniphest T278116

Instrumentation: Link inspector
Closed, ResolvedPublic
Actions

Description

Associated feature: T269644: Add a link: link inspector

As the user proceeds through the task, they will use the “link inspector” dialog. We need to record events for these actions:

  • An impression for when the link inspector focuses on a link.
  • Selecting the left arrow to go back.
  • Selecting the right arrow to skip forward.
  • Selecting “yes”.
  • Selecting “no”.
  • Opening up the blue link to view the full article of the link target.
  • Reopening the rejection dialog via the ellipsis link.
  • Mobile only: tapping the “?” to open the help panel.

For each of those events, we want to include:

  • Which suggestion in the series they are on (e.g. “2/7”)
  • The anchor text for the link suggestion.
  • The target article for the link suggestion.
  • The probability score for the link suggestion.

If the user changes their response on a given link, that should be recorded as an additional event, but we do not need to indicate that it was a change.

We also need to record an event for when the user selects a link suggestion in the body of the article by tapping or clicking on it.

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
AddLink: LinkSuggestionInteraction logger and instrumentationmediawiki/extensions/GrowthExperimentswmf/1.37.0-wmf.5+300 -49
AddLink: LinkSuggestionInteraction logger and instrumentationmediawiki/extensions/GrowthExperimentsmaster+300 -49
Customize query in gerrit

Related Objects
Search...

Event Timeline

kostajh created this task.Mar 22 2021, 12:29 PM
kostajh mentioned this in T273827: Add a link: instrumentation.
kostajh moved this task from Backlog to Post-release backlog on the Add-Link-Structured-Task board.
kostajh moved this task from Incoming to Ready for Development on the Growth-Team (Sprint 0 (Growth Team)) board.
kostajh mentioned this in T269644: Add a link: link inspector.
kostajh updated the task description. (Show Details)Mar 24 2021, 10:32 AM
kostajh moved this task from Post-release backlog to April 19 - April 23 on the Add-Link-Structured-Task board.Mar 29 2021, 11:33 AM
kostajh moved this task from Ready for Development to Incoming on the Growth-Team (Sprint 0 (Growth Team)) board.Mar 30 2021, 7:12 AM
• mewoph mentioned this in T278119: Instrumentation: Verify existing workflows (help panel, post-edit dialog, HomepageModule).Apr 2 2021, 10:26 PM
kostajh triaged this task as Medium priority.Apr 14 2021, 12:53 PM
MBinder_WMF added a project: Growth-Team-Filtering.Apr 15 2021, 6:47 PM
kostajh moved this task from Incoming to Ready for Development on the Growth-Team (Sprint 0 (Growth Team)) board.Apr 20 2021, 9:20 AM
• Rileych removed a project: Growth-Team-Filtering.Apr 20 2021, 4:28 PM
leila unsubscribed.Apr 20 2021, 4:52 PM
kostajh moved this task from April 19 - April 23 to April 26 - April 30 on the Add-Link-Structured-Task board.Apr 26 2021, 9:40 AM
MBinder_WMF unsubscribed.Apr 26 2021, 5:37 PM
kostajh moved this task from April 26 - April 30 to May 3 - May 7 on the Add-Link-Structured-Task board.May 3 2021, 2:42 PM
kostajh claimed this task.May 5 2021, 3:42 PM
kostajh moved this task from Ready for Development to In Progress on the Growth-Team (Sprint 0 (Growth Team)) board.
gerritbot added a comment.May 5 2021, 4:32 PM

Change 684127 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/GrowthExperiments@master] WIP AddLink InstrumentationInstrumentation code

https://gerrit.wikimedia.org/r/684127

gerritbot added a project: Patch-For-Review.May 5 2021, 4:32 PM
kostajh moved this task from May 3 - May 7 to May 10 - May 14 on the Add-Link-Structured-Task board.May 10 2021, 3:47 PM
gerritbot added a comment.May 13 2021, 10:53 AM

Change 690070 had a related patch set uploaded (by Gergő Tisza; author: Kosta Harlan):

[mediawiki/extensions/GrowthExperiments@wmf/1.37.0-wmf.5] AddLink: LinkSuggestionInteraction logger and instrumentation

https://gerrit.wikimedia.org/r/690070

gerritbot added a comment.May 13 2021, 11:18 AM

Change 684127 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@master] AddLink: LinkSuggestionInteraction logger and instrumentation

https://gerrit.wikimedia.org/r/684127

gerritbot added a comment.May 13 2021, 11:47 AM

Change 690070 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@wmf/1.37.0-wmf.5] AddLink: LinkSuggestionInteraction logger and instrumentation

https://gerrit.wikimedia.org/r/690070

• Tgr moved this task from May 10 - May 14 to Done / QA on the Add-Link-Structured-Task board.May 13 2021, 12:05 PM
• Tgr moved this task from In Progress to QA on the Growth-Team (Sprint 0 (Growth Team)) board.
Maintenance_bot removed a project: Patch-For-Review.May 13 2021, 12:11 PM
Stashbot mentioned this in T278487: Instrumentation: Number of phrases not found in document.May 13 2021, 12:40 PM

Mentioned in SAL (#wikimedia-operations) [2021-05-13T12:40:40Z] <tgr@deploy1002> Synchronized php-1.37.0-wmf.5/extensions/GrowthExperiments: Backport: instrumentation patches ([[gerrit:690070|]] [[gerrit:690071|]] [[gerrit:690072|]] [[gerrit:690073|]]) (T278116 T278117 T278114 T278177 T278487 T278112 T278111 T278118) (duration: 01m 09s)

Stashbot mentioned this in T278114: Instrumentation: Suggestions mode.May 13 2021, 12:40 PM
Stashbot mentioned this in T278117: Instrumentation: Rejection dialog.
Stashbot mentioned this in T278112: Instrumentation: dialog for no suggestions available.
Stashbot mentioned this in T278111: Instrumentation: Onboarding.
Stashbot mentioned this in T278177: Add a link: create new Schema.
Stashbot mentioned this in T278118: Instrumentation: Edit summary.
Etonkovidova closed this task as Resolved.Jul 22 2021, 8:51 PM

As the user proceeds through the task, they will use the “link inspector” dialog. We need to record events for >these actions:

  • An impression for when the link inspector focuses on a link.
{action: "impression", action_data: "link_target=Telescope;link_text=telescope;probabil…er=0;rejection_reason=;acceptance_state=undecided", is_mobile: false, active_interface: "recommendedlinktoolbar_dialog", newcomer_task_token: "7475cd7ae6988827e02c", …}
$schema: "/analytics/mediawiki/structured_task/article/link_suggestion_interaction/1.0.0"
action: "impression"
action_data: "link_target=Telescope;link_text=telescope;probability_score=0.5141173601150513;series_number=0;rejection_reason=;acceptance_state=undecided"
active_interface: "recommendedlinktoolbar_dialog"
dt: "2021-07-22T20:03:29.922Z"
homepage_pageview_token: "8cl5p8v8t21gp41ugfs4h9u37ukltu9a"
is_mobile: false
meta: {stream: "mediawiki.structured_task.article.link_suggestion_interaction", domain: "test.wikipedia.org"}
newcomer_task_token: "7475cd7ae6988827e02c"
page_id: 54306
page_title: "Testing1"
{action: "suggestion_focus", action_data: "link_target=Telescope;link_text=telescope;probabil…on=;acceptance_state=undecided;manual_focus=false", is_mobile: false, active_interface: "recommendedlinktoolbar_dialog", newcomer_task_token: "7475cd7ae6988827e02c", …}
$schema: "/analytics/mediawiki/structured_task/article/link_suggestion_interaction/1.0.0"
action: "suggestion_focus"
action_data: "link_target=Telescope;link_text=telescope;probability_score=0.5141173601150513;series_number=0;rejection_reason=;acceptance_state=undecided;manual_focus=false"
active_interface: "recommendedlinktoolbar_dialog"
dt: "2021-07-22T20:03:29.647Z"
homepage_pageview_token: "8cl5p8v8t21gp41ugfs4h9u37ukltu9a"
is_mobile: false
meta: {stream: "mediawiki.structured_task.article.link_suggestion_interaction", domain: "test.wikipedia.org"}
newcomer_task_token: "7475cd7ae6988827e02c"
page_id: 54306
page_title: "Testing1"
  • Selecting the left arrow to go back.
{action: "back", action_data: "link_target=Science fiction;link_text=science fict…ber=2;rejection_reason=;acceptance_state=accepted", is_mobile: false, active_interface: "recommendedlinktoolbar_dialog", newcomer_task_token: "7475cd7ae6988827e02c", …}
$schema: "/analytics/mediawiki/structured_task/article/link_suggestion_interaction/1.0.0"
action: "back"
action_data: "link_target=Science fiction;link_text=science fiction;probability_score=0.7401999235153198;series_number=2;rejection_reason=;acceptance_state=accepted"
active_interface: "recommendedlinktoolbar_dialog"
dt: "2021-07-22T20:12:12.465Z"
homepage_pageview_token: "8cl5p8v8t21gp41ugfs4h9u37ukltu9a"
is_mobile: false
meta: {stream: "mediawiki.structured_task.article.link_suggestion_interaction", domain: "test.wikipedia.org"}
newcomer_task_token: "7475cd7ae6988827e02c"
page_id: 54306
page_title: "Testing1"
{action: "suggestion_focus", action_data: "link_target=NASA;link_text=NASA;probability_score=…on=;acceptance_state=undecided;manual_focus=false", is_mobile: false, active_interface: "recommendedlinktoolbar_dialog", newcomer_task_token: "7475cd7ae6988827e02c", …}
$schema: "/analytics/mediawiki/structured_task/article/link_suggestion_interaction/1.0.0"
action: "suggestion_focus"
action_data: "link_target=NASA;link_text=NASA;probability_score=0.6295512318611145;series_number=1;rejection_reason=;acceptance_state=undecided;manual_focus=false"
active_interface: "recommendedlinktoolbar_dialog"
dt: "2021-07-22T20:12:12.488Z"
homepage_pageview_token: "8cl5p8v8t21gp41ugfs4h9u37ukltu9a"
is_mobile: false
meta: {stream: "mediawiki.structured_task.article.link_suggestion_interaction", domain: "test.wikipedia.org"}
newcomer_task_token: "7475cd7ae6988827e02c"
page_id: 54306
page_title: "Testing1"
  • Selecting the right arrow to skip forward.
{action: "next", action_data: "link_target=Telescope;link_text=telescope;probabil…er=0;rejection_reason=;acceptance_state=undecided", is_mobile: false, active_interface: "recommendedlinktoolbar_dialog", newcomer_task_token: "7475cd7ae6988827e02c", …}
$schema: "/analytics/mediawiki/structured_task/article/link_suggestion_interaction/1.0.0"
action: "next"
action_data: "link_target=Telescope;link_text=telescope;probability_score=0.5141173601150513;series_number=0;rejection_reason=;acceptance_state=undecided"
active_interface: "recommendedlinktoolbar_dialog"
dt: "2021-07-22T20:05:29.546Z"
homepage_pageview_token: "8cl5p8v8t21gp41ugfs4h9u37ukltu9a"
is_mobile: false
meta: {stream: "mediawiki.structured_task.article.link_suggestion_interaction", domain: "test.wikipedia.org"}
newcomer_task_token: "7475cd7ae6988827e02c"
page_id: 54306
page_title: "Testing1"
{action: "suggestion_skip", action_data: "link_target=Telescope;link_text=telescope;probabil…er=0;rejection_reason=;acceptance_state=undecided", is_mobile: false, active_interface: "recommendedlinktoolbar_dialog", newcomer_task_token: "7475cd7ae6988827e02c", …}
$schema: "/analytics/mediawiki/structured_task/article/link_suggestion_interaction/1.0.0"
action: "suggestion_skip"
action_data: "link_target=Telescope;link_text=telescope;probability_score=0.5141173601150513;series_number=0;rejection_reason=;acceptance_state=undecided"
active_interface: "recommendedlinktoolbar_dialog"
dt: "2021-07-22T20:05:29.551Z"
homepage_pageview_token: "8cl5p8v8t21gp41ugfs4h9u37ukltu9a"
is_mobile: false
meta: {stream: "mediawiki.structured_task.article.link_suggestion_interaction", domain: "test.wikipedia.org"}
newcomer_task_token: "7475cd7ae6988827e02c"
page_id: 54306
page_title: "Testing1"
  • Selecting “yes”.
{action: "suggestion_accept", action_data: "link_target=Science fiction;link_text=science fict…er=2;rejection_reason=;acceptance_state=undecided", is_mobile: false, active_interface: "recommendedlinktoolbar_dialog", newcomer_task_token: "7475cd7ae6988827e02c", …}
$schema: "/analytics/mediawiki/structured_task/article/link_suggestion_interaction/1.0.0"
action: "suggestion_accept"
action_data: "link_target=Science fiction;link_text=science fiction;probability_score=0.7401999235153198;series_number=2;rejection_reason=;acceptance_state=undecided"
active_interface: "recommendedlinktoolbar_dialog"
dt: "2021-07-22T20:11:25.360Z"
homepage_pageview_token: "8cl5p8v8t21gp41ugfs4h9u37ukltu9a"
is_mobile: false
meta: {stream: "mediawiki.structured_task.article.link_suggestion_interaction", domain: "test.wikipedia.org"}
newcomer_task_token: "7475cd7ae6988827e02c"
page_id: 54306
page_title: "Testing1"
  • Selecting “no”.
{action: "suggestion_reject", action_data: "link_target=NASA;link_text=NASA;probability_score=…er=1;rejection_reason=;acceptance_state=undecided", is_mobile: false, active_interface: "recommendedlinktoolbar_dialog", newcomer_task_token: "7475cd7ae6988827e02c", …}
$schema: "/analytics/mediawiki/structured_task/article/link_suggestion_interaction/1.0.0"
action: "suggestion_reject"
action_data: "link_target=NASA;link_text=NASA;probability_score=0.6295512318611145;series_number=1;rejection_reason=;acceptance_state=undecided"
active_interface: "recommendedlinktoolbar_dialog"
dt: "2021-07-22T20:13:37.165Z"
homepage_pageview_token: "8cl5p8v8t21gp41ugfs4h9u37ukltu9a"
is_mobile: false
meta: {stream: "mediawiki.structured_task.article.link_suggestion_interaction", domain: "test.wikipedia.org"}
newcomer_task_token: "7475cd7ae6988827e02c"
page_id: 54306
page_title: "Testing1"
{action: "impression", action_data: "link_target=NASA;link_text=NASA;probability_score=…ection_reason=undefined;acceptance_state=rejected", is_mobile: false, active_interface: "rejection_dialog", newcomer_task_token: "7475cd7ae6988827e02c", …}
$schema: "/analytics/mediawiki/structured_task/article/link_suggestion_interaction/1.0.0"
action: "impression"
action_data: "link_target=NASA;link_text=NASA;probability_score=0.6295512318611145;series_number=1;rejection_reason=undefined;acceptance_state=rejected"
active_interface: "rejection_dialog"
dt: "2021-07-22T20:13:37.204Z"
homepage_pageview_token: "8cl5p8v8t21gp41ugfs4h9u37ukltu9a"
is_mobile: false
meta: {stream: "mediawiki.structured_task.article.link_suggestion_interaction", domain: "test.wikipedia.org"}
newcomer_task_token: "7475cd7ae6988827e02c"
page_id: 54306
page_title: "Testing1"
{action: "close", action_data: "link_target=NASA;link_text=NASA;probability_score=…ection_reason=undefined;acceptance_state=rejected", is_mobile: false, active_interface: "rejection_dialog", newcomer_task_token: "7475cd7ae6988827e02c", …}
$schema: "/analytics/mediawiki/structured_task/article/link_suggestion_interaction/1.0.0"
action: "close"
action_data: "link_target=NASA;link_text=NASA;probability_score=0.6295512318611145;series_number=1;rejection_reason=undefined;acceptance_state=rejected"
active_interface: "rejection_dialog"
dt: "2021-07-22T20:14:55.801Z"
homepage_pageview_token: "8cl5p8v8t21gp41ugfs4h9u37ukltu9a"
is_mobile: false
meta: {stream: "mediawiki.structured_task.article.link_suggestion_interaction", domain: "test.wikipedia.org"}
newcomer_task_token: "7475cd7ae6988827e02c"
page_id: 54306
page_title: "Testing1"
  • Opening up the blue link to view the full article of the link target.
{action: "link_click", action_data: "link_target=NASA;link_text=NASA;probability_score=…ection_reason=undefined;acceptance_state=rejected", is_mobile: false, active_interface: "recommendedlinktoolbar_dialog", newcomer_task_token: "7475cd7ae6988827e02c", …}
$schema: "/analytics/mediawiki/structured_task/article/link_suggestion_interaction/1.0.0"
action: "link_click"
action_data: "link_target=NASA;link_text=NASA;probability_score=0.6295512318611145;series_number=1;rejection_reason=undefined;acceptance_state=rejected"
active_interface: "recommendedlinktoolbar_dialog"
dt: "2021-07-22T20:15:59.557Z"
homepage_pageview_token: "8cl5p8v8t21gp41ugfs4h9u37ukltu9a"
is_mobile: false
meta: {stream: "mediawiki.structured_task.article.link_suggestion_interaction", domain: "test.wikipedia.org"}
newcomer_task_token: "7475cd7ae6988827e02c"
page_id: 54306
page_title: "Testing1"
  • Reopening the rejection dialog via the ellipsis link.
{action: "suggestion_view_rejection_reasons", action_data: "link_target=NASA;link_text=NASA;probability_score=…ection_reason=undefined;acceptance_state=rejected", is_mobile: false, active_interface: "recommendedlinktoolbar_dialog", newcomer_task_token: "7475cd7ae6988827e02c", …}
$schema: "/analytics/mediawiki/structured_task/article/link_suggestion_interaction/1.0.0"
action: "suggestion_view_rejection_reasons"
action_data: "link_target=NASA;link_text=NASA;probability_score=0.6295512318611145;series_number=1;rejection_reason=undefined;acceptance_state=rejected"
active_interface: "recommendedlinktoolbar_dialog"
dt: "2021-07-22T20:16:35.938Z"
homepage_pageview_token: "8cl5p8v8t21gp41ugfs4h9u37ukltu9a"
is_mobile: false
meta: {stream: "mediawiki.structured_task.article.link_suggestion_interaction", domain: "test.wikipedia.org"}
newcomer_task_token: "7475cd7ae6988827e02c"
page_id: 54306
page_title: "Testing1"
{action: "impression", action_data: "link_target=NASA;link_text=NASA;probability_score=…ection_reason=undefined;acceptance_state=rejected", is_mobile: false, active_interface: "rejection_dialog", newcomer_task_token: "7475cd7ae6988827e02c", …}
$schema: "/analytics/mediawiki/structured_task/article/link_suggestion_interaction/1.0.0"
action: "impression"
action_data: "link_target=NASA;link_text=NASA;probability_score=0.6295512318611145;series_number=1;rejection_reason=undefined;acceptance_state=rejected"
active_interface: "rejection_dialog"
dt: "2021-07-22T20:16:35.960Z"
homepage_pageview_token: "8cl5p8v8t21gp41ugfs4h9u37ukltu9a"
is_mobile: false
meta: {stream: "mediawiki.structured_task.article.link_suggestion_interaction", domain: "test.wikipedia.org"}
newcomer_task_token: "7475cd7ae6988827e02c"
page_id: 54306
page_title: "Testing1"
  • Mobile only: tapping the “?” to open the help panel.
{event: {…}, schema: "HelpPanel", webHost: "test.wikipedia.org", wiki: "testwiki", $schema: "/analytics/legacy/helppanel/1.0.1", …}
$schema: "/analytics/legacy/helppanel/1.0.1"
client_dt: "2021-07-22T20:18:30.839Z"
event: {action: "open", action_data: "", user_id: 50416, user_editcount: 0, context: "editing", …}
meta: {stream: "eventlogging_HelpPanel", domain: "test.wikipedia.org"}
schema: "HelpPanel"
webHost: "test.wikipedia.org"
wiki: "testwiki"

The following specs are also seem to be in place:

For each of those events, we want to include:

  • Which suggestion in the series they are on (e.g. “2/7”)

The info on which link a user is on reflected series_number.

  • The anchor text for the link suggestion.

Done.

  • The target article for the link suggestion.

Done.

  • The probability score for the link suggestion.

Done.

If the user changes their response on a given link, that should be recorded as an additional event, but we do
not need to indicate that it was a change.

Done.

We also need to record an event for when the user selects a link suggestion in the body of the article by >tapping or clicking on it.

Done with manual_focus=true

Urbanecm_WMF added a project: GrowthExperiments-NewcomerTasks.Jan 21 2026, 2:39 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits