Page MenuHomePhabricator

MNeisler (Megan Neisler)
Analyst, Product Analytics

Projects

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Monday

  • Clear sailing ahead.

User Details

User Since
Mar 6 2015, 10:50 PM (322 w, 21 h)
Availability
Available
LDAP User
MNeisler
MediaWiki User
MNeisler (WMF) [ Global Accounts ]

Recent Activity

Wed, May 5

MNeisler moved T277349: [SPIKE] Determine what – if any – new instrumentation is needed for notifications from Current Quarter to Tracking on the Product-Analytics board.
Wed, May 5, 10:56 PM · Product-Analytics, Editing-team (FY2020-21 Kanban Board), DiscussionTools
MNeisler edited projects for T277349: [SPIKE] Determine what – if any – new instrumentation is needed for notifications, added: Product-Analytics; removed Product-Analytics (Kanban).
Wed, May 5, 10:55 PM · Product-Analytics, Editing-team (FY2020-21 Kanban Board), DiscussionTools
MNeisler reassigned T277349: [SPIKE] Determine what – if any – new instrumentation is needed for notifications from MNeisler to ppelberg.
Wed, May 5, 10:13 PM · Product-Analytics, Editing-team (FY2020-21 Kanban Board), DiscussionTools
MNeisler added a comment to T281928: No event fired for clicking the language button.

@jrobson - Yes, this should be included as part of the UniversalLanguageSelector Schema if possible.

Wed, May 5, 8:24 PM · Desktop Improvements, Readers-Web-Backlog (Kanbanana-FY-2020-21)
MNeisler moved T277349: [SPIKE] Determine what – if any – new instrumentation is needed for notifications from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.
Wed, May 5, 11:46 AM · Product-Analytics, Editing-team (FY2020-21 Kanban Board), DiscussionTools
MNeisler added a comment to T277349: [SPIKE] Determine what – if any – new instrumentation is needed for notifications.

I drafted a list of events that need to be tracked in order to calculate the metrics outlined in the measurement plan. Please see the "Events to be tracked" column in the instrumentation spec document.

Wed, May 5, 11:46 AM · Product-Analytics, Editing-team (FY2020-21 Kanban Board), DiscussionTools

Tue, May 4

MNeisler moved T261842: Create schema to track users opting in/out of desktop improvements from Doing to Needs Review on the Product-Analytics (Kanban) board.
Tue, May 4, 2:38 PM · Patch-For-Review, Product-Analytics (Kanban), MW-1.37-notes (1.37.0-wmf.1; 2021-04-13), Readers-Web-Backlog (Kanbanana-FY-2020-21), Desktop Improvements

Fri, Apr 30

MNeisler edited projects for T277349: [SPIKE] Determine what – if any – new instrumentation is needed for notifications, added: Product-Analytics (Kanban); removed Product-Analytics.
Fri, Apr 30, 9:29 PM · Product-Analytics, Editing-team (FY2020-21 Kanban Board), DiscussionTools

Wed, Apr 28

MNeisler added a comment to T261842: Create schema to track users opting in/out of desktop improvements.

I completed a QA of the events logged from the new schema (mediawiki_pref_diff).

Wed, Apr 28, 7:02 PM · Patch-For-Review, Product-Analytics (Kanban), MW-1.37-notes (1.37.0-wmf.1; 2021-04-13), Readers-Web-Backlog (Kanbanana-FY-2020-21), Desktop Improvements

Tue, Apr 27

MNeisler triaged T280841: [SPIKE] Determine where new wikitext editor instrumentation should be stored as Medium priority.
Tue, Apr 27, 4:34 PM · Product-Analytics (Kanban), Editing-team (Tracking), Better Use Of Data, WikiEditor
MNeisler moved T269664: Determine opt-out rate for desktop improvements feature on test wikis pt 2 from Doing to Next 2 weeks on the Product-Analytics (Kanban) board.
Tue, Apr 27, 4:33 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking), Desktop Improvements
MNeisler moved T240697: Measure % of edits coming from users without JS from Upcoming Quarter to Current Quarter on the Product-Analytics board.
Tue, Apr 27, 12:52 PM · Editing-team (Tracking), Product-Analytics, User-Ryasmeen, Readers-Web-Backlog (Tracking), VisualEditor

Mon, Apr 26

MNeisler added a comment to T280841: [SPIKE] Determine where new wikitext editor instrumentation should be stored.

Thanks @DLynch. I agree that Option #2 (Sending a VEFU event) seems like the best method. In addition to not requiring any schema modifications, I think that VEFU is a better fit for this type of event and the analysis will still be pretty straightforward (I'll just need to do a join to EditAttemptStep on session id)

Mon, Apr 26, 10:28 PM · Product-Analytics (Kanban), Editing-team (Tracking), Better Use Of Data, WikiEditor
MNeisler added a comment to T252057: Run A/B test to evaluate impact of Reply tool .

@ppelberg - I've reviewed the Reply Tool project page and made some edits [i] to clarify the results.

Mon, Apr 26, 9:01 PM · Editing-team (Tracking), Product-Analytics (Kanban), DiscussionTools, OWC2020
MNeisler edited projects for T274869: Instrumentation QA for new search widget, added: Product-Analytics (Kanban); removed Product-Analytics.
Mon, Apr 26, 5:46 PM · Product-Analytics (Kanban), MW-1.37-notes (1.37.0-wmf.3; 2021-04-27), MW-1.36-notes (1.36.0-wmf.35; 2021-03-16), Performance-Team (Radar), Desktop Improvements, Readers-Web-Backlog (Kanbanana-FY-2020-21)
MNeisler added a comment to T274869: Instrumentation QA for new search widget.

The deployment for this change is scheduled for this Thursday, April 29th. I will plan to QA following deployment after data has been logged and available to query in SearchSatisfaction.

Mon, Apr 26, 5:46 PM · Product-Analytics (Kanban), MW-1.37-notes (1.37.0-wmf.3; 2021-04-27), MW-1.36-notes (1.36.0-wmf.35; 2021-03-16), Performance-Team (Radar), Desktop Improvements, Readers-Web-Backlog (Kanbanana-FY-2020-21)
MNeisler added a comment to T275762: Instrument clicks to links in the Languages list in the sidebar.

Thanks @MNeisler -- it looks like the token field will be coming through as an empty string per a recent change in the WikimediaEvents extension. So as it is, token will not be a reliable field to track unique user clicks (it was left in for backwards compatibility).

Mon, Apr 26, 4:50 AM · MW-1.37-notes (1.37.0-wmf.3; 2021-04-27), Vector (Language in header), Readers-Web-Backlog (Kanbanana-FY-2020-21), MediaWiki-extensions-WikimediaEvents, Desktop Improvements

Fri, Apr 23

MNeisler added a comment to T252057: Run A/B test to evaluate impact of Reply tool .

@MNeisler: to be doubly sure, would it be more accurate to say, "...we observed a 79.5% decrease in the revert rate for comments Junior Contributors made..." vs. "...we observed a 79.5% decrease in the revert rate for comments made..."?

Fri, Apr 23, 10:57 PM · Editing-team (Tracking), Product-Analytics (Kanban), DiscussionTools, OWC2020
MNeisler moved T280841: [SPIKE] Determine where new wikitext editor instrumentation should be stored from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.
Fri, Apr 23, 8:46 PM · Product-Analytics (Kanban), Editing-team (Tracking), Better Use Of Data, WikiEditor
MNeisler edited projects for T280841: [SPIKE] Determine where new wikitext editor instrumentation should be stored, added: Product-Analytics (Kanban); removed Product-Analytics.
Fri, Apr 23, 8:45 PM · Product-Analytics (Kanban), Editing-team (Tracking), Better Use Of Data, WikiEditor
MNeisler added a comment to T252057: Run A/B test to evaluate impact of Reply tool .

Here is the updated report.

Fri, Apr 23, 7:54 PM · Editing-team (Tracking), Product-Analytics (Kanban), DiscussionTools, OWC2020

Wed, Apr 21

MNeisler added a comment to T275762: Instrument clicks to links in the Languages list in the sidebar.

hi @MNeisler - associated patch should be approved/merged shortly. After some discussion with @nray, it appears that the web_session_id for authenticated users persists between opening/quitting tabs within a browser. However when a browser is quit/reopened, a new web_session_id is generated. Let us know if this is problematic for tracking user clicks appropriately - hopefully not.

Wed, Apr 21, 11:25 PM · MW-1.37-notes (1.37.0-wmf.3; 2021-04-27), Vector (Language in header), Readers-Web-Backlog (Kanbanana-FY-2020-21), MediaWiki-extensions-WikimediaEvents, Desktop Improvements
MNeisler added a comment to T273912: Topic Subscriptions: Design usability test (Junior Contributors).

Does this test written in such a way that we are getting the kind of (qualitative feedback) that we are not getting in T274215?

@iamjessklein

Wed, Apr 21, 7:25 PM · User-Ryasmeen, Editing-team (FY2020-21 Kanban Board), DiscussionTools, Editing Design
MNeisler moved T274215: Create response rate measurement plan from Doing to Needs Sign-off on the Product-Analytics (Kanban) board.
Wed, Apr 21, 2:29 PM · Product-Analytics (Kanban), Editing-team (Tracking), DiscussionTools
MNeisler edited projects for T274215: Create response rate measurement plan, added: Product-Analytics (Kanban); removed Product-Analytics.
Wed, Apr 21, 2:29 PM · Product-Analytics (Kanban), Editing-team (Tracking), DiscussionTools
MNeisler added a comment to T274215: Create response rate measurement plan.

@MNeisler, for each of the "Scenarios" in this sheet [i] whose "Priority" has been marked as "HIGH" or "MEDIUM" can you please do the below?

Wed, Apr 21, 2:29 PM · Product-Analytics (Kanban), Editing-team (Tracking), DiscussionTools

Fri, Apr 16

MNeisler moved T269664: Determine opt-out rate for desktop improvements feature on test wikis pt 2 from Blocked to Doing on the Product-Analytics (Kanban) board.
Fri, Apr 16, 11:37 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking), Desktop Improvements
MNeisler added a comment to T261842: Create schema to track users opting in/out of desktop improvements.

I confirmed that events for this schema are logged and stored in eventlogging data as event.mediawiki_pref_diff.

Fri, Apr 16, 4:30 PM · Patch-For-Review, Product-Analytics (Kanban), MW-1.37-notes (1.37.0-wmf.1; 2021-04-13), Readers-Web-Backlog (Kanbanana-FY-2020-21), Desktop Improvements

Wed, Apr 14

MNeisler moved T269664: Determine opt-out rate for desktop improvements feature on test wikis pt 2 from Doing to Blocked on the Product-Analytics (Kanban) board.
Wed, Apr 14, 10:56 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking), Desktop Improvements
MNeisler added a comment to T275762: Instrument clicks to links in the Languages list in the sidebar.

@cjming - Thanks for the ping! If possible, it would be useful to have a user identifier to track the number of users. This will help us understand the frequency of usage across users (i.e. Is it just a few users clicking it frequently or a number of users clicking it once?)

Wed, Apr 14, 7:55 PM · MW-1.37-notes (1.37.0-wmf.3; 2021-04-27), Vector (Language in header), Readers-Web-Backlog (Kanbanana-FY-2020-21), MediaWiki-extensions-WikimediaEvents, Desktop Improvements

Tue, Apr 13

MNeisler added a comment to T269664: Determine opt-out rate for desktop improvements feature on test wikis pt 2.

Pending availability of data in the new desktop preference schema, I reviewed data in mediawiki [user properties table] to determine the percent of logged-in users at all of the pliot wikis (looking at both registered users and active users) that have their vector skin preference changed to legacy as of 13 April 2021. See summary below:

Tue, Apr 13, 11:08 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking), Desktop Improvements
MNeisler moved T269664: Determine opt-out rate for desktop improvements feature on test wikis pt 2 from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.
Tue, Apr 13, 9:44 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking), Desktop Improvements
MNeisler edited projects for T261842: Create schema to track users opting in/out of desktop improvements, added: Product-Analytics (Kanban); removed Product-Analytics.
Tue, Apr 13, 6:07 PM · Patch-For-Review, Product-Analytics (Kanban), MW-1.37-notes (1.37.0-wmf.1; 2021-04-13), Readers-Web-Backlog (Kanbanana-FY-2020-21), Desktop Improvements
MNeisler moved T263053: New Discussion Tool: calculate adoption metrics from Upcoming Quarter to Current Quarter on the Product-Analytics board.
Tue, Apr 13, 4:37 PM · Product-Analytics, Editing-team (Tracking), DiscussionTools, OWC2020 (New Discussion 1.0)
MNeisler moved T277349: [SPIKE] Determine what – if any – new instrumentation is needed for notifications from Upcoming Quarter to Current Quarter on the Product-Analytics board.
Tue, Apr 13, 4:37 PM · Product-Analytics, Editing-team (FY2020-21 Kanban Board), DiscussionTools

Apr 6 2021

MNeisler moved T277002: Make it possible to review the number of edits made with the new discussion tool in real time from Upcoming Quarter to Current Quarter on the Product-Analytics board.
Apr 6 2021, 11:02 PM · Product-Analytics, Editing-team (Tracking), DiscussionTools
MNeisler added a comment to T267011: Analyze results of A/B test for new search location.

@mpopov Thanks for the heads up! I've fixed the link and replaced any references I could find to the old link with the updated link to the final report.

Apr 6 2021, 6:04 PM · Product-Analytics (Kanban), Desktop Improvements, Readers-Web-Backlog (Tracking)
MNeisler moved T274869: Instrumentation QA for new search widget from Triage to Tracking on the Product-Analytics board.
Apr 6 2021, 5:17 PM · Product-Analytics (Kanban), MW-1.37-notes (1.37.0-wmf.3; 2021-04-27), MW-1.36-notes (1.36.0-wmf.35; 2021-03-16), Performance-Team (Radar), Desktop Improvements, Readers-Web-Backlog (Kanbanana-FY-2020-21)
MNeisler edited projects for T274869: Instrumentation QA for new search widget, added: Product-Analytics; removed Product-Analytics (Kanban).
Apr 6 2021, 5:17 PM · Product-Analytics (Kanban), MW-1.37-notes (1.37.0-wmf.3; 2021-04-27), MW-1.36-notes (1.36.0-wmf.35; 2021-03-16), Performance-Team (Radar), Desktop Improvements, Readers-Web-Backlog (Kanbanana-FY-2020-21)

Apr 5 2021

MNeisler added a comment to T275200: Analyze results of A/B test for new search widget.

The AB impact analysis report is still in progress but here is an initial look at the number of search sessions initiated by wiki and search group by users in the AB test.

Apr 5 2021, 11:50 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking)
MNeisler edited projects for T269664: Determine opt-out rate for desktop improvements feature on test wikis pt 2, added: Product-Analytics (Kanban); removed Product-Analytics.
Apr 5 2021, 9:21 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking), Desktop Improvements
MNeisler moved T274607: Add SearchSatisfaction to the allowlist from Triage to Current Quarter on the Product-Analytics board.
Apr 5 2021, 9:21 PM · Product-Analytics
MNeisler edited projects for T274607: Add SearchSatisfaction to the allowlist, added: Product-Analytics; removed Product-Analytics (Kanban).
Apr 5 2021, 9:21 PM · Product-Analytics

Apr 1 2021

MNeisler moved T269664: Determine opt-out rate for desktop improvements feature on test wikis pt 2 from Upcoming Quarter to Current Quarter on the Product-Analytics board.

Per discussions with @ovasileva, we are aiming to complete this in time to include in the Q3 Tuning Sessions. Data will be calculated using the new desktop opt-in and opt-out schema, which is currently in development T261842.

Apr 1 2021, 5:17 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking), Desktop Improvements
MNeisler reopened T274869: Instrumentation QA for new search widget as "Open".
Apr 1 2021, 3:44 AM · Product-Analytics (Kanban), MW-1.37-notes (1.37.0-wmf.3; 2021-04-27), MW-1.36-notes (1.36.0-wmf.35; 2021-03-16), Performance-Team (Radar), Desktop Improvements, Readers-Web-Backlog (Kanbanana-FY-2020-21)
MNeisler reopened T274869: Instrumentation QA for new search widget, a subtask of T275200: Analyze results of A/B test for new search widget, as Open.
Apr 1 2021, 3:44 AM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking)
MNeisler added a comment to T274869: Instrumentation QA for new search widget.

@phuedx @ovasileva
While collecting data needed for the AB analysis, I noticed a large imbalance again between new and old search widget sessions.

Apr 1 2021, 3:43 AM · Product-Analytics (Kanban), MW-1.37-notes (1.37.0-wmf.3; 2021-04-27), MW-1.36-notes (1.36.0-wmf.35; 2021-03-16), Performance-Team (Radar), Desktop Improvements, Readers-Web-Backlog (Kanbanana-FY-2020-21)

Mar 26 2021

MNeisler moved T275200: Analyze results of A/B test for new search widget from Needs Investigation to Doing on the Product-Analytics (Kanban) board.
Mar 26 2021, 6:52 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking)
MNeisler added a comment to T252057: Run A/B test to evaluate impact of Reply tool .

Here is the draft report on the KPIs and guardrails for the Reply Tool AB Test for review.

Mar 26 2021, 6:42 PM · Editing-team (Tracking), Product-Analytics (Kanban), DiscussionTools, OWC2020

Mar 25 2021

MNeisler added a comment to T278368: Measure percentage of Commons users opting out of MediaSearch as the default search experience.

The product analytics team will review and prioritize this request during our next board review meeting on Tuesday, 30 March 2021.

Mar 25 2021, 5:18 PM · Structured-Data-Backlog, SDAW-MediaSearch, Product-Analytics

Mar 24 2021

MNeisler added a comment to T273986: How often are language settings used?.

@ovasileva - Just checking in on the status of this task. Any questions or further analysis needed?

Mar 24 2021, 4:35 PM · Product-Analytics (Kanban), Desktop Improvements, Readers-Web-Backlog (Tracking)

Mar 23 2021

MNeisler added a comment to T261842: Create schema to track users opting in/out of desktop improvements.

This is correct - the PrefUpdate instrumentation is designed to only send out events when user initiated preference changes occur [1]. I think there may have been confusion regarding this fact. From my understanding, the PrefUpdate schema/instrumentation isn't currently meeting our needs because it isn't sending the before state of a preference change (e.g. we are interested in knowing that a user went from latest Vector to Monobook) which is info that the PrefUpdate instrumentation doesn't currently send. cc @MNeisler if there are any corrections or additional needs that I missed here.

Mar 23 2021, 6:54 PM · Patch-For-Review, Product-Analytics (Kanban), MW-1.37-notes (1.37.0-wmf.1; 2021-04-13), Readers-Web-Backlog (Kanbanana-FY-2020-21), Desktop Improvements
MNeisler moved T263054: New Discussion Tool: calculate workflow engagement metrics from Triage to Upcoming Quarter on the Product-Analytics board.
Mar 23 2021, 12:16 AM · Product-Analytics, Editing-team (Tracking), DiscussionTools
MNeisler edited projects for T263054: New Discussion Tool: calculate workflow engagement metrics , added: Product-Analytics; removed Product-Analytics (Kanban).
Mar 23 2021, 12:16 AM · Product-Analytics, Editing-team (Tracking), DiscussionTools
MNeisler reassigned T263054: New Discussion Tool: calculate workflow engagement metrics from MNeisler to ppelberg.
Mar 23 2021, 12:16 AM · Product-Analytics, Editing-team (Tracking), DiscussionTools

Mar 22 2021

MNeisler updated the task description for T263054: New Discussion Tool: calculate workflow engagement metrics .
Mar 22 2021, 1:59 PM · Product-Analytics, Editing-team (Tracking), DiscussionTools
MNeisler added a comment to T263054: New Discussion Tool: calculate workflow engagement metrics .

A question: can we include a metric that helps us know the percentage of Junior and Senior Contributors who use the New Discussion Tool to add at least one topic and then turn off the feature?
Thinking: knowing if a relatively large number of people are turning off the tool after using it will serve as a helpful leading indicator for issues people may be having with the tool we are not aware of.

Mar 22 2021, 1:54 PM · Product-Analytics, Editing-team (Tracking), DiscussionTools
MNeisler triaged T277002: Make it possible to review the number of edits made with the new discussion tool in real time as Medium priority.
Mar 22 2021, 1:33 PM · Product-Analytics, Editing-team (Tracking), DiscussionTools

Mar 18 2021

MNeisler triaged T277349: [SPIKE] Determine what – if any – new instrumentation is needed for notifications as Medium priority.
Mar 18 2021, 8:48 PM · Product-Analytics, Editing-team (FY2020-21 Kanban Board), DiscussionTools
MNeisler added a project to T277002: Make it possible to review the number of edits made with the new discussion tool in real time: Product-Analytics.
Mar 18 2021, 8:48 PM · Product-Analytics, Editing-team (Tracking), DiscussionTools
MNeisler added a project to T277349: [SPIKE] Determine what – if any – new instrumentation is needed for notifications: Product-Analytics.
Mar 18 2021, 8:47 PM · Product-Analytics, Editing-team (FY2020-21 Kanban Board), DiscussionTools

Mar 16 2021

MNeisler moved T261842: Create schema to track users opting in/out of desktop improvements from Triage to Tracking on the Product-Analytics board.
Mar 16 2021, 7:04 PM · Patch-For-Review, Product-Analytics (Kanban), MW-1.37-notes (1.37.0-wmf.1; 2021-04-13), Readers-Web-Backlog (Kanbanana-FY-2020-21), Desktop Improvements
MNeisler edited projects for T261842: Create schema to track users opting in/out of desktop improvements, added: Product-Analytics; removed Product-Analytics (Kanban).
Mar 16 2021, 7:04 PM · Patch-For-Review, Product-Analytics (Kanban), MW-1.37-notes (1.37.0-wmf.1; 2021-04-13), Readers-Web-Backlog (Kanbanana-FY-2020-21), Desktop Improvements

Mar 15 2021

MNeisler moved T261842: Create schema to track users opting in/out of desktop improvements from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.
Mar 15 2021, 6:45 PM · Patch-For-Review, Product-Analytics (Kanban), MW-1.37-notes (1.37.0-wmf.1; 2021-04-13), Readers-Web-Backlog (Kanbanana-FY-2020-21), Desktop Improvements
MNeisler closed T274869: Instrumentation QA for new search widget as Resolved.

Non AB Test Events
I noticed that from March 2nd to today, we have not recorded any Vue.Js search sessions initiated by logged-in users on wikis not included in the AB test. Vue.Js search events on non-pilot wikis were only recorded from Feb 25th through > March 2nd. @phuedx @ovasileva Is that expected?

Mar 15 2021, 6:45 PM · Product-Analytics (Kanban), MW-1.37-notes (1.37.0-wmf.3; 2021-04-27), MW-1.36-notes (1.36.0-wmf.35; 2021-03-16), Performance-Team (Radar), Desktop Improvements, Readers-Web-Backlog (Kanbanana-FY-2020-21)
MNeisler updated the task description for T274869: Instrumentation QA for new search widget.
Mar 15 2021, 6:44 PM · Product-Analytics (Kanban), MW-1.37-notes (1.37.0-wmf.3; 2021-04-27), MW-1.36-notes (1.36.0-wmf.35; 2021-03-16), Performance-Team (Radar), Desktop Improvements, Readers-Web-Backlog (Kanbanana-FY-2020-21)
MNeisler closed T274869: Instrumentation QA for new search widget, a subtask of T275200: Analyze results of A/B test for new search widget, as Resolved.
Mar 15 2021, 6:44 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking)
MNeisler added a comment to T274869: Instrumentation QA for new search widget.

AB Test Events

Mar 15 2021, 3:57 PM · Product-Analytics (Kanban), MW-1.37-notes (1.37.0-wmf.3; 2021-04-27), MW-1.36-notes (1.36.0-wmf.35; 2021-03-16), Performance-Team (Radar), Desktop Improvements, Readers-Web-Backlog (Kanbanana-FY-2020-21)

Mar 12 2021

AdHuikeshoven awarded T252057: Run A/B test to evaluate impact of Reply tool a Love token.
Mar 12 2021, 8:20 PM · Editing-team (Tracking), Product-Analytics (Kanban), DiscussionTools, OWC2020
MNeisler added a comment to T252057: Run A/B test to evaluate impact of Reply tool .

Here is a quick look at the overall edit completion rate for replies on talk pages by editor type. Data is based on edit attempts by users in the AB test recorded in EditAttemptStep from 12 February 2021 through 10 March 2021. Note: This data currently reflects logged-in users across all experience levels. I will review edit completion rate by experience level when I complete the preliminary analysis on KPIs.

Mar 12 2021, 7:26 PM · Editing-team (Tracking), Product-Analytics (Kanban), DiscussionTools, OWC2020
MNeisler added a project to T261842: Create schema to track users opting in/out of desktop improvements: Product-Analytics (Kanban).
Mar 12 2021, 6:13 PM · Patch-For-Review, Product-Analytics (Kanban), MW-1.37-notes (1.37.0-wmf.1; 2021-04-13), Readers-Web-Backlog (Kanbanana-FY-2020-21), Desktop Improvements

Mar 11 2021

MNeisler moved T274215: Create response rate measurement plan from Triage to Tracking on the Product-Analytics board.
Mar 11 2021, 12:27 AM · Product-Analytics (Kanban), Editing-team (Tracking), DiscussionTools
MNeisler edited projects for T274215: Create response rate measurement plan, added: Product-Analytics; removed Product-Analytics (Kanban).
Mar 11 2021, 12:26 AM · Product-Analytics (Kanban), Editing-team (Tracking), DiscussionTools
MNeisler reassigned T274215: Create response rate measurement plan from MNeisler to ppelberg.

I've reviewed and added my proposed quantitative metrics for the Hypotheses and Guardrails to the Talk pages project/Notifications/Measurement plan.

Mar 11 2021, 12:26 AM · Product-Analytics (Kanban), Editing-team (Tracking), DiscussionTools

Mar 10 2021

MNeisler added a comment to T274869: Instrumentation QA for new search widget.

FYI - I rechecked the Search Vue.JS AB test events and the search sessions initiated look much more balanced between the two test groups. Here are the search sessions initiated for each wiki and search group recorded since the deployment of the fix.

Mar 10 2021, 11:50 PM · Product-Analytics (Kanban), MW-1.37-notes (1.37.0-wmf.3; 2021-04-27), MW-1.36-notes (1.36.0-wmf.35; 2021-03-16), Performance-Team (Radar), Desktop Improvements, Readers-Web-Backlog (Kanbanana-FY-2020-21)
MNeisler reassigned T263054: New Discussion Tool: calculate workflow engagement metrics from MNeisler to ppelberg.

@ppelberg - I updated the task description's Workflow engagement metrics section with suggested metrics.

Mar 10 2021, 8:43 PM · Product-Analytics, Editing-team (Tracking), DiscussionTools
MNeisler updated the task description for T263054: New Discussion Tool: calculate workflow engagement metrics .
Mar 10 2021, 8:31 PM · Product-Analytics, Editing-team (Tracking), DiscussionTools
MNeisler updated the task description for T263054: New Discussion Tool: calculate workflow engagement metrics .
Mar 10 2021, 8:25 PM · Product-Analytics, Editing-team (Tracking), DiscussionTools
MNeisler added a comment to T274869: Instrumentation QA for new search widget.

I ran a check of the data logged following the deployment of the AB test to all of the pilot wikis.

Mar 10 2021, 5:00 AM · Product-Analytics (Kanban), MW-1.37-notes (1.37.0-wmf.3; 2021-04-27), MW-1.36-notes (1.36.0-wmf.35; 2021-03-16), Performance-Team (Radar), Desktop Improvements, Readers-Web-Backlog (Kanbanana-FY-2020-21)

Mar 9 2021

MNeisler added a comment to T276967: Turn off Reply Tool A/B test.

@matmarex - Yes, confirmed. We can disable logging the event.bucket field as it's no longer relevant since the AB test will be disabled. (cc @ppelberg )

Mar 9 2021, 10:35 PM · MW-1.36-notes (1.36.0-wmf.33; 2021-03-02), Patch-For-Review, Editing-team (FY2020-21 Kanban Board), DiscussionTools

Mar 8 2021

MNeisler added a comment to T261842: Create schema to track users opting in/out of desktop improvements.

@MNeisler I'm still fuzzy on what is desired with this ticket and was hoping you could shed some light on the following questions I have:

Mar 8 2021, 11:46 PM · Patch-For-Review, Product-Analytics (Kanban), MW-1.37-notes (1.37.0-wmf.1; 2021-04-13), Readers-Web-Backlog (Kanbanana-FY-2020-21), Desktop Improvements

Mar 5 2021

MNeisler moved T257211: Determine frequency of usage of language variants from Current Quarter to Upcoming Quarter on the Product-Analytics board.
Mar 5 2021, 5:49 PM · Product-Analytics, Platform Engineering, UniversalLanguageSelector, MediaWiki-Language-converter, Chinese-Sites, Readers-Web-Backlog (Tracking), Desktop Improvements
MNeisler moved T271358: QA Modern Event Platform editing schema migrations from Current Quarter to Upcoming Quarter on the Product-Analytics board.
Mar 5 2021, 5:48 PM · Editing-team (Tracking), Product-Analytics
MNeisler moved T230133: Some EditAttemptStep events on existing pages do not have revision IDs from Current Quarter to Upcoming Quarter on the Product-Analytics board.
Mar 5 2021, 5:48 PM · Editing-team (Tracking), MW-1.36-notes (1.36.0-wmf.25; 2021-01-05), Patch-For-Review, User-Ryasmeen, MW-1.35-notes (1.35.0-wmf.20; 2020-02-18), Product-Analytics, VisualEditor
MNeisler edited projects for T275200: Analyze results of A/B test for new search widget, added: Product-Analytics (Kanban); removed Product-Analytics.
Mar 5 2021, 5:47 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking)
MNeisler moved T240697: Measure % of edits coming from users without JS from Needs Investigation to Upcoming Quarter on the Product-Analytics board.

Moving this to upcoming quarter for now. Timing will depend on the implementation of instrumentation in (T263505).

Mar 5 2021, 5:46 PM · Editing-team (Tracking), Product-Analytics, User-Ryasmeen, Readers-Web-Backlog (Tracking), VisualEditor
MNeisler edited projects for T240697: Measure % of edits coming from users without JS, added: Product-Analytics; removed Product-Analytics (Kanban).
Mar 5 2021, 5:44 PM · Editing-team (Tracking), Product-Analytics, User-Ryasmeen, Readers-Web-Backlog (Tracking), VisualEditor

Mar 3 2021

MNeisler moved T274215: Create response rate measurement plan from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.
Mar 3 2021, 4:31 PM · Product-Analytics (Kanban), Editing-team (Tracking), DiscussionTools

Mar 2 2021

MNeisler triaged T252057: Run A/B test to evaluate impact of Reply tool as Medium priority.
Mar 2 2021, 9:35 PM · Editing-team (Tracking), Product-Analytics (Kanban), DiscussionTools, OWC2020
MNeisler moved T252057: Run A/B test to evaluate impact of Reply tool from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.
Mar 2 2021, 9:34 PM · Editing-team (Tracking), Product-Analytics (Kanban), DiscussionTools, OWC2020
MNeisler added a project to T252057: Run A/B test to evaluate impact of Reply tool : Product-Analytics (Kanban).
Mar 2 2021, 9:32 PM · Editing-team (Tracking), Product-Analytics (Kanban), DiscussionTools, OWC2020
MNeisler claimed T252057: Run A/B test to evaluate impact of Reply tool .
Mar 2 2021, 9:31 PM · Editing-team (Tracking), Product-Analytics (Kanban), DiscussionTools, OWC2020
MNeisler reassigned T273986: How often are language settings used? from MNeisler to ovasileva.

@ovasileva Here are my initial findings on the usage of language settings. Let me know if this helps answer the team's questions or you need any additional info/breakdowns.

Mar 2 2021, 8:47 PM · Product-Analytics (Kanban), Desktop Improvements, Readers-Web-Backlog (Tracking)
MNeisler triaged T274215: Create response rate measurement plan as Medium priority.
Mar 2 2021, 5:45 PM · Product-Analytics (Kanban), Editing-team (Tracking), DiscussionTools

Feb 24 2021

MNeisler added a project to T274215: Create response rate measurement plan: Product-Analytics (Kanban).
Feb 24 2021, 11:49 PM · Product-Analytics (Kanban), Editing-team (Tracking), DiscussionTools
MNeisler claimed T274215: Create response rate measurement plan.
Feb 24 2021, 11:49 PM · Product-Analytics (Kanban), Editing-team (Tracking), DiscussionTools
MNeisler reassigned T272544: Differentiate between edits to existing sections and the creation of new sections from MNeisler to ppelberg.
Feb 24 2021, 10:48 PM · Editing-team (FY2020-21 Kanban Board), Product-Analytics (Kanban), MW-1.36-notes (1.36.0-wmf.29; 2021-02-02), WikiEditor, VisualEditor, DiscussionTools
MNeisler added a comment to T273096: Add DiscussionTools a/b test bucket information to events from VisualEditor and WikiEditor..

Megan: in the context of EditAttemptStep does page include edit attempts initiated via section edit links? Schema:EditAttemptStep leads me to think "yes," tho I wanted to be sure.

It's the integration, so yes. (You could distinguish section ones from init_type. But only for source mode, because we still haven't released visual section editing anywhere.)

Feb 24 2021, 9:48 PM · Editing-team (FY2020-21 Kanban Board), MW-1.36-notes (1.36.0-wmf.27; 2021-01-19), Patch-For-Review, Product-Analytics (Kanban), DiscussionTools, OWC2020
MNeisler moved T273986: How often are language settings used? from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.
Feb 24 2021, 8:54 PM · Product-Analytics (Kanban), Desktop Improvements, Readers-Web-Backlog (Tracking)
MNeisler moved T272544: Differentiate between edits to existing sections and the creation of new sections from Doing to Needs Sign-off on the Product-Analytics (Kanban) board.

@ppelberg
I completed QA of the new instrumentation changes and confirmed that the events are logging as expected and we can now differentiate between edits to existing sections vs the creation of new section using current VE/Wikieditor workflows.

Feb 24 2021, 8:15 PM · Editing-team (FY2020-21 Kanban Board), Product-Analytics (Kanban), MW-1.36-notes (1.36.0-wmf.29; 2021-02-02), WikiEditor, VisualEditor, DiscussionTools