Page MenuHomePhabricator

Add an image: measurement
Closed, ResolvedPublic

Description

For measurement with "add an image", we are going to cleave closely to the same research questions, measurements, experiment plan, and leading indicators as for "add a link" in the "Add a Link - Measurement Specification" document. This task and its subtasks contain the full set of instrumentation needs.


For users who have the Homepage enabled, we want to capture their user ID along with the information below whenever they interact with an "add an image" task.

  • Distinguish by wiki.
  • Analyze how much time elapses between each action.
  • Know whether each action was taken from desktop or mobile.
  • Know which article the user is on (through page title and page id).
  • Include timestamps with millisecond precision.

Event Timeline

Change 736070 had a related patch set uploaded (by MewOphaswongse; author: MewOphaswongse):

[schemas/event/secondary@master] Add an image: update schema

https://gerrit.wikimedia.org/r/736070

Change 736070 merged by jenkins-bot:

[schemas/event/secondary@master] Add an image: update schema

https://gerrit.wikimedia.org/r/736070

MMiller_WMF renamed this task from Add an image: instrumentation to Add an image: measurement.Nov 23 2021, 11:52 PM
Etonkovidova claimed this task.

Checked as a part of verifying add image instrumentation. Below are two examples of recorded events.

The example of the eventlogging event on testwiki wmf.9:

A user is on Special:Homepage and selects `image-recommendation`filter and some topics: 
 schema: 'HomepageModule', webHost: 'test.wikipedia.org', wiki: 'testwiki', $schema: '/analytics/legacy/homepagemodule/1.3.0', …}
$schema: "/analytics/legacy/homepagemodule/1.3.0"
client_dt: "2021-12-01T19:21:51.622Z"
event:
action: "se-fetch-tasks"
action_data: "taskTypes=image-recommendation;taskCount=6;topics=medicine-and-health"
homepage_pageview_token: "7561cd6oif04t73gefgpujgnenc0mgrr"
is_mobile: true
mode: "mobile-overlay"
module: "suggested-edits"
state: "activated"
user_editcount: 14
user_id: 45328
user_variant: "imagerecommendation"
[[Prototype]]: Object
meta: {stream: 'eventlogging_HomepageModule', domain: 'test.wikipedia.org'}
schema: "HomepageModule"
webHost: "test.wikipedia.org"
wiki: "testwiki"

A user is on an article with image recommendation: 
'impression', action_data: 'filename=Ехоенцефалоскоп.jpg;recommendation_source…tion_reasons=undefined;acceptance_state=undecided', is_mobile: true, active_interface: 'recommendedimagetoolbar_dialog', newcomer_task_token: '0c8ed8d278c8b392ce3f', …}
$schema: "/analytics/mediawiki/structured_task/article/image_suggestion_interaction/1.1.2"
action: "impression"
action_data: "filename=Ехоенцефалоскоп.jpg;recommendation_source=wikipedia;recommendation_source_projects=ruwiki;series_number=1;total_suggestions=1;rejection_reasons=undefined;acceptance_state=undecided"
active_interface: "recommendedimagetoolbar_dialog"
dt: "2021-12-01T19:27:19.571Z"
homepage_pageview_token: "7561cd6oif04t73gefgpujgnenc0mgrr"
is_mobile: true
meta: {stream: 'mediawiki.structured_task.article.image_suggestion_interaction', domain: 'test.wikipedia.org'}
newcomer_task_token: "0c8ed8d278c8b392ce3f"
page_id: 121896
page_title: "Echoencephalography"

For users who have the Homepage enabled, we want to capture their user ID along with the information below whenever they interact with an "add an image" task.

  • Distinguish by wiki.

The wiki name is present: wiki: "testwiki"

  • Analyze how much time elapses between each action.

A timestamp is present for all events.

  • Know whether each action was taken from desktop or mobile.
is_mobile: true
mode: "mobile-overlay"
  • Know which article the user is on (through page title and page id).
page_id: 121896
page_title: "Echoencephalography"
  • Include timestamps with millisecond precision.

client_dt: "2021-12-01T19:21:51.622Z"