Edit Cards v3: instrumentation post-deployment data checks
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	ppelberg
	Aug 12 2019, 4:37 PM

Description

Overview

This task involves the work with making sure we are logging data in such a way that we will be able to track the additional events we implemented as part of Edit Cards v3. Information about the events that are being added can be found in this task: T229841 and this patch: https://gerrit.wikimedia.org/r/534167

Additional instrumentation

We would like to make sure we are logging the events that fire when a contributor types text into the "Text" field within "Wikipedia" or "External site" panel/tab of the link dialog. More context can be found in T229841.

"Done"

Product Analytics has verified the events listed in the "Additional instrumentation" section are being logged correctly

Related Objects
Search...

Status	Assigned	Task
Resolved	None	T221247 [Epic] Mobile context items
Resolved	None	T229830 Edit Cards: deploy v3 to all wikis
Resolved	MNeisler	T230367 Edit Cards v3: instrumentation post-deployment data checks
Resolved	Ryasmeen	T230369 Edit Cards v3: verify logging events are firing properly
Resolved	DLynch	T229841 Instrument Edit Cards v3

Event Timeline

ppelberg created this task.Aug 12 2019, 4:37 PM

ppelberg added a parent task: T229830: Edit Cards: deploy v3 to all wikis.

ppelberg added a subtask: T230369: Edit Cards v3: verify logging events are firing properly.Aug 12 2019, 4:50 PM

nshahquinn-wmf triaged this task as Medium priority.Aug 20 2019, 6:38 PM

nshahquinn-wmf moved this task from Triage to Next Up on the Product-Analytics board.

We can't do this until the instrumentation itself is decided on (T229841), so we're blocked for now.

By the time we're unblocked, I expect I'll be fully off the Editing team, so Megan will be the one to take it on.

MNeisler added a subscriber: Mayakp.wiki.Sep 3 2019, 10:15 PM

Updates to description:

Adding details about the additional event that was added in Edit Card v3 and will need to be checked as part of this task

ppelberg mentioned this in T229841: Instrument Edit Cards v3.Sep 9 2019, 2:58 PM

Once the VE as Default work is complete we will pull this work into our current sprint

JTannerWMF mentioned this in T230369: Edit Cards v3: verify logging events are firing properly.Sep 10 2019, 3:39 PM

MNeisler moved this task from Blocked to Doing on the Product-Analytics board.Sep 17 2019, 8:54 PM

I reviewed the data and confirmed that we are logging events as expected for when a contributor types text into the "Text" field within "Wikipedia" or "External site" panel/tab. These events are
logged as: “mf.schemaVisualEditorFeatureUse {feature: "link", action: "label-input", editingSessionId: "..."}”.

Events started appearing in early September (see table below) and all events are recorded only for the link feature as expected. Full notebook.

Date	Count of label-input actions
2019-09-11	20
2019-09-12	45
2019-09-13	36
2019-09-14	48
2019-09-15	35
2019-09-16	278
2019-09-17	628
2019-09-18	584
2019-09-19	532
2019-09-20	603
2019-09-21	669
2019-09-22	648
2019-09-23	357

@DLynch @ppelberg: Just a note that it looks like based on current instrumentation we don't decipher between edits to the text field when the user is in the "Wikipedia" panel vs edits to the text field when the user is in the "External Site" panel. Both action types are currently recorded as "label-input". Was that the intention or did we want to decipher between the two?

Other than that, everything looks good from my side.

Thank you for checking, @MNeisler and for drawing attention to the text inputs for editing an internal (Wikipedia) and external link's label:

In T230367#5517748, @MNeisler wrote:

@DLynch @ppelberg: Just a note that it looks like based on current instrumentation we don't decipher between edits to the text field when the user is in the "Wikipedia" panel vs edits to the text field when the user is in the "External Site" panel. Both action types are currently recorded as "label-input". Was that the intention or did we want to decipher between the two?

@DLynch and I just discussed and confirmed the following:

There being one tracking event – label-input – for edits to the internal and external link' "text" fields is expected considering: these fields are one in the same, not distinct.

If at some future time we needed to distinguish between edits to the internal and external text fields, we could infer this by looking at which context item was initially shown and checking for whether a panel-switch event ensued (meaning the contributor would have switched from the initial context item that was shown)

ppelberg closed this task as Resolved.Sep 25 2019, 3:47 PM

Restricted Application added a project: User-Ryasmeen. · View Herald TranscriptSep 25 2019, 3:47 PM

ppelberg closed subtask T230369: Edit Cards v3: verify logging events are firing properly as Resolved.Dec 24 2019, 7:16 PM

Edit Cards v3: instrumentation post-deployment data checksClosed, ResolvedPublicActions