Page MenuHomePhabricator

MNeisler (Megan Neisler)
Analyst, Product Analytics

Projects

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Saturday

  • Clear sailing ahead.

User Details

User Since
Mar 6 2015, 10:50 PM (247 w, 5 d)
Availability
Available
LDAP User
MNeisler
MediaWiki User
MNeisler (WMF) [ Global Accounts ]

Recent Activity

Today

MNeisler moved T221728: Analyze impact of edit cards in the mobile visual editor from Next Up to Doing on the Product-Analytics (Kanban) board.
Thu, Dec 5, 1:33 AM · Product-Analytics (Kanban), VisualEditor, VisualEditor-Edit Cards
MNeisler moved T237075: Investigate drop in mobile VE edit completion rate among unregistered users from Doing to Needs Review on the Product-Analytics (Kanban) board.
Thu, Dec 5, 1:25 AM · VisualEditor (Current work), Product-Analytics (Kanban), VisualEditor-MediaWiki-Mobile
MNeisler added a comment to T237075: Investigate drop in mobile VE edit completion rate among unregistered users.

I completed a review into the drop in mobile VE edit completion rate among unregistered users and confirmed that the decrease is likely caused by an increase in the number of VE edits attempts by unregistered users following the VE AB test deployment date.

Thu, Dec 5, 1:25 AM · VisualEditor (Current work), Product-Analytics (Kanban), VisualEditor-MediaWiki-Mobile

Tue, Dec 3

MNeisler added a project to T239672: Many special pages missing from pageview_hourly dataset starting on July 23, 2019: Analytics.
Tue, Dec 3, 5:09 PM · Analytics, Product-Analytics
MNeisler triaged T239672: Many special pages missing from pageview_hourly dataset starting on July 23, 2019 as Medium priority.
Tue, Dec 3, 5:09 PM · Analytics, Product-Analytics
MNeisler created T239672: Many special pages missing from pageview_hourly dataset starting on July 23, 2019.
Tue, Dec 3, 12:17 AM · Analytics, Product-Analytics

Mon, Dec 2

MNeisler moved T233889: Analyze retention rate of Junior Contributors using talk page features from Doing to Needs Review on the Product-Analytics (Kanban) board.

I updated the analysis to differentiate between short and long-term retention rates for junior talk page contributors. The below charts show the year over year trends from October 2016 through September 2019.

Mon, Dec 2, 10:16 PM · Product-Analytics (Kanban), OWC2020
MNeisler updated the task description for T233889: Analyze retention rate of Junior Contributors using talk page features.
Mon, Dec 2, 4:22 PM · Product-Analytics (Kanban), OWC2020

Mon, Nov 25

MNeisler moved T238971: Consider revising Junior Contributor definition from Triage to Tracking on the Product-Analytics board.
Mon, Nov 25, 9:52 PM · Product-Analytics, VisualEditor (Current work), OWC2020
MNeisler claimed T237750: Investigate user behavior on the new AMC Watchlist page.
Mon, Nov 25, 6:03 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking)
MNeisler moved T237075: Investigate drop in mobile VE edit completion rate among unregistered users from Next Up to Doing on the Product-Analytics (Kanban) board.
Mon, Nov 25, 2:56 PM · VisualEditor (Current work), Product-Analytics (Kanban), VisualEditor-MediaWiki-Mobile
MNeisler moved T234559: AMC KPI Report Q2 from Doing to Needs Review on the Product-Analytics (Kanban) board.
Mon, Nov 25, 2:53 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking)
MNeisler added a comment to T234559: AMC KPI Report Q2 .

Here is a link to the final AMC metrics report.

Mon, Nov 25, 2:53 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking)

Fri, Nov 22

MNeisler added a comment to T238699: Program Snapshot: AMC.

I updated the staging deck with a slide on AMC and shared with Toby. Let me know if you need any changes.

Fri, Nov 22, 1:37 AM · Product-Analytics (Kanban)

Wed, Nov 20

MNeisler closed T234563: Whitelist MobileWebUIActionsTracking data stream as Resolved.
Wed, Nov 20, 9:19 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking)
MNeisler moved T238699: Program Snapshot: AMC from Next Up to Doing on the Product-Analytics (Kanban) board.
Wed, Nov 20, 7:42 PM · Product-Analytics (Kanban)

Tue, Nov 19

MNeisler updated subscribers of T234563: Whitelist MobileWebUIActionsTracking data stream.

@mforns @Nuria - Just checking in on the status of this patch. I'd like to get this deployed soon if possible.

Tue, Nov 19, 5:22 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking)

Mon, Nov 18

MNeisler added a comment to T237605: Create kerberos principals for users.

Hello! here's my request for Kerberos credentials for Hadoop access on stat100X and notebook100X. My username is mneisler.

Mon, Nov 18, 11:46 PM · Analytics-Kanban, Analytics

Sat, Nov 16

MNeisler added a comment to T233889: Analyze retention rate of Junior Contributors using talk page features.

I found a bug in my query that was double-counting some of the talk page contributors for each month. Below is the updated chart (please disregard the one posted above).

Sat, Nov 16, 2:22 AM · Product-Analytics (Kanban), OWC2020

Fri, Nov 15

MNeisler added a comment to T233889: Analyze retention rate of Junior Contributors using talk page features.

Here's the current year over year breakdown. This shows the 30-day Junior Contributor talk page retention for each month over the past three years.

Fri, Nov 15, 10:24 PM · Product-Analytics (Kanban), OWC2020
MNeisler moved T233889: Analyze retention rate of Junior Contributors using talk page features from Next Up to Doing on the Product-Analytics (Kanban) board.
Fri, Nov 15, 12:25 AM · Product-Analytics (Kanban), OWC2020
MNeisler edited projects for T233889: Analyze retention rate of Junior Contributors using talk page features, added: Product-Analytics (Kanban); removed Product-Analytics.
Fri, Nov 15, 12:25 AM · Product-Analytics (Kanban), OWC2020

Tue, Nov 12

MNeisler added a comment to T234559: AMC KPI Report Q2 .

Are these new actions or are they actions that we have cannibalised from the desktop site? Are we able to compare desktop for the same period? Regardless these seem like impressive numbers!

Tue, Nov 12, 5:34 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking)

Sat, Nov 9

MNeisler moved T233261: Analyze "junior contributor" talk page participation from Doing to Needs Review on the Product-Analytics (Kanban) board.
Sat, Nov 9, 1:19 AM · Product-Analytics (Kanban), OWC2020
MNeisler added a comment to T233261: Analyze "junior contributor" talk page participation.

I pulled together a table showing the average number of talk page contributors, average overall monthly contributors, and proportion of talk page contributors for all Wikipedias. You can add filters to sort by the size of each column or look at specific wikis.

Sat, Nov 9, 1:17 AM · Product-Analytics (Kanban), OWC2020

Fri, Nov 8

MNeisler moved T236860: Analyze mobile VE edit completion rate for "Quarter in Review" from Doing to Needs Review on the Product-Analytics (Kanban) board.
Fri, Nov 8, 10:15 PM · Product-Analytics (Kanban), VisualEditor (Current work), VisualEditor-MediaWiki-Mobile
MNeisler added a comment to T237204: Make the new design of mobile watchlist opt-in.

@ovasileva - Yes, I created a subtask to look into further (T237750)

Fri, Nov 8, 5:29 PM · Readers-Web-Backlog (Needs Product Owner Decisions), Advanced Mobile Contributions
MNeisler moved T237750: Investigate user behavior on the new AMC Watchlist page from Backlog to Analyst Consultation on the Readers-Web-Backlog (Tracking) board.
Fri, Nov 8, 5:26 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking)
MNeisler created T237750: Investigate user behavior on the new AMC Watchlist page.
Fri, Nov 8, 5:26 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking)

Nov 1 2019

MNeisler added a comment to T236860: Analyze mobile VE edit completion rate for "Quarter in Review".

Here is an updated summary of results with edit count breakdown revised to the following edit count buckets: 1-4; 5-99; 100-999; 1,000+; unregistered. See notebook for additional details and charts.

Nov 1 2019, 10:27 PM · Product-Analytics (Kanban), VisualEditor (Current work), VisualEditor-MediaWiki-Mobile
MNeisler updated the task description for T236860: Analyze mobile VE edit completion rate for "Quarter in Review".
Nov 1 2019, 7:59 PM · Product-Analytics (Kanban), VisualEditor (Current work), VisualEditor-MediaWiki-Mobile
MNeisler added a comment to T236860: Analyze mobile VE edit completion rate for "Quarter in Review".

Comments

  • The drop ~4-July drop in the edit completion rate among logged-out users is curious – I'm glad you highlighted this and that we will explore this further. I've created a new task for this investigation. Tho, if you think it is better suited as a part of this task, please boldly close this one as a duplicate: T237075
Nov 1 2019, 7:54 PM · Product-Analytics (Kanban), VisualEditor (Current work), VisualEditor-MediaWiki-Mobile
MNeisler added a comment to T234559: AMC KPI Report Q2 .

Here is a link to the current draft report, which includes additional per wiki and editor experience breakdowns for the primary KPIs (mobile web edit rate, retention rate, and mobile web moderation actions).

Nov 1 2019, 7:14 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking)

Oct 31 2019

MNeisler added a comment to T237053: Add namespace field to pageviews_hourly in Superset and Turnilo.

Please see edits_hourly in Superspet (and edits_hourl.hql file) for reference on how the namespace dimension was added for that data source.

Oct 31 2019, 8:42 PM · Product-Analytics
MNeisler updated the task description for T237053: Add namespace field to pageviews_hourly in Superset and Turnilo.
Oct 31 2019, 8:38 PM · Product-Analytics
MNeisler created T237053: Add namespace field to pageviews_hourly in Superset and Turnilo.
Oct 31 2019, 8:35 PM · Product-Analytics
MNeisler added a comment to T236860: Analyze mobile VE edit completion rate for "Quarter in Review".

Here are the initial results.

Oct 31 2019, 6:58 PM · Product-Analytics (Kanban), VisualEditor (Current work), VisualEditor-MediaWiki-Mobile

Oct 30 2019

MNeisler triaged T236860: Analyze mobile VE edit completion rate for "Quarter in Review" as High priority.
Oct 30 2019, 3:19 PM · Product-Analytics (Kanban), VisualEditor (Current work), VisualEditor-MediaWiki-Mobile
MNeisler edited projects for T236860: Analyze mobile VE edit completion rate for "Quarter in Review", added: Product-Analytics (Kanban); removed Product-Analytics.
Oct 30 2019, 3:18 PM · Product-Analytics (Kanban), VisualEditor (Current work), VisualEditor-MediaWiki-Mobile

Oct 29 2019

MNeisler updated the task description for T233261: Analyze "junior contributor" talk page participation.
Oct 29 2019, 4:53 PM · Product-Analytics (Kanban), OWC2020
MNeisler added a comment to T233760: Determine target wiki selection criteria.

...as part of T233261 and can normalize the data per my comment above to show wikis with the highest proportion of unique contributors participating on talk pages each month.

This sounds great. As for the denominator, "...unique contributors participating on talk pages each month." makes sense to me considering we are seeking to understand, currently, how much contributors depend on/use talk pages.
Although, in the point above [1], it seemed like the denominator was still TBD: Which do you think we should go with?

Oct 29 2019, 4:49 PM · Editing Design, Editing-team, OWC2020
MNeisler updated the task description for T233261: Analyze "junior contributor" talk page participation.
Oct 29 2019, 12:51 AM · Product-Analytics (Kanban), OWC2020
MNeisler updated the task description for T233261: Analyze "junior contributor" talk page participation.
Oct 29 2019, 12:51 AM · Product-Analytics (Kanban), OWC2020
MNeisler added a comment to T233261: Analyze "junior contributor" talk page participation.

Overall number of distinct contributors participating on Wikipedia talk pages each month by experience level:

Oct 29 2019, 12:49 AM · Product-Analytics (Kanban), OWC2020

Oct 28 2019

MNeisler updated subscribers of T233760: Determine target wiki selection criteria.
Oct 28 2019, 7:25 PM · Editing Design, Editing-team, OWC2020

Oct 25 2019

MNeisler added a project to T236510: Analyze monthly active unique Junior Contributors: Product-Analytics.
Oct 25 2019, 7:51 PM · Product-Analytics (Kanban), VisualEditor (Current work), Editing-team, OWC2020

Oct 24 2019

MNeisler moved T214935: Examine clickthrough ratios for different page elements of action=history pages from Doing to Tracking on the Product-Analytics board.
Oct 24 2019, 4:35 PM · Product-Analytics, Readers-Web-Backlog (Needs Product Owner Decisions)
MNeisler edited projects for T214935: Examine clickthrough ratios for different page elements of action=history pages, added: Product-Analytics; removed Product-Analytics (Kanban).
Oct 24 2019, 4:35 PM · Product-Analytics, Readers-Web-Backlog (Needs Product Owner Decisions)
MNeisler moved T229926: Desktop behavior data requests from Doing to Next Up on the Product-Analytics (Kanban) board.
Oct 24 2019, 4:33 PM · Product-Analytics (Kanban), Desktop Improvements, Readers-Web-Backlog (Design)
MNeisler moved T233261: Analyze "junior contributor" talk page participation from Needs Review to Doing on the Product-Analytics (Kanban) board.
Oct 24 2019, 4:32 PM · Product-Analytics (Kanban), OWC2020
MNeisler updated the task description for T233261: Analyze "junior contributor" talk page participation.
Oct 24 2019, 4:32 PM · Product-Analytics (Kanban), OWC2020
MNeisler set Due Date to Oct 28 2019, 12:00 AM on T233261: Analyze "junior contributor" talk page participation.
Oct 24 2019, 4:32 PM · Product-Analytics (Kanban), OWC2020

Oct 23 2019

MNeisler updated subscribers of T234865: Spike: Does our current pageview data identify whether browsers are non-JS?.

I found a report, Clients_without_JavaScript, Analytics completed in 2015 that looked at the percent of page requests from browsers without JavaScript support. The MediaWiki page includes useful details about the methodology, preliminary results, and queries used. The reviewed data sample came from webrequest using a combination of the webrequest_source and user_agent fields.

Oct 23 2019, 7:45 PM · Product-Analytics (Kanban)
MNeisler updated the task description for T234807: Determine impact of $wgMFNoindexPages search traffic to arwiki, zhwiki, hiwiki, itwiki, nlwiki, kowiki.
Oct 23 2019, 4:47 PM · Product-Analytics (Kanban), Chinese-Sites, Readers-Web-Backlog (Tracking)
MNeisler moved T234865: Spike: Does our current pageview data identify whether browsers are non-JS? from Next Up to Doing on the Product-Analytics (Kanban) board.
Oct 23 2019, 4:35 PM · Product-Analytics (Kanban)
MNeisler closed T231024: Some save success events do not contain a new revision ID, a subtask of T118063: Clean up the EditAttemptStep schema and its implementations, as Resolved.
Oct 23 2019, 4:28 PM · Product-Analytics, Epic, VisualEditor, VisualEditor-MediaWiki, Contributors-Analysis
MNeisler closed T231024: Some save success events do not contain a new revision ID as Resolved.

I discussed this with @Neil_P._Quinn_WMF. @matmarex's explanation makes sense and these are likely NULL edits.

Oct 23 2019, 4:28 PM · User-Ryasmeen, Product-Analytics, VisualEditor
MNeisler added a comment to T234559: AMC KPI Report Q2 .

Here's a quick high-level summary of the AMC metric numbers gathered so far. I'll post a moderation actions update soon and a full report with more details by early next week.
I reviewed data starting at the date of AMC deployment (varies based on wiki [1]) through September 30, 2019.

Oct 23 2019, 4:47 AM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking)

Oct 22 2019

MNeisler claimed T234807: Determine impact of $wgMFNoindexPages search traffic to arwiki, zhwiki, hiwiki, itwiki, nlwiki, kowiki.
Oct 22 2019, 3:51 PM · Product-Analytics (Kanban), Chinese-Sites, Readers-Web-Backlog (Tracking)
MNeisler added a project to T234807: Determine impact of $wgMFNoindexPages search traffic to arwiki, zhwiki, hiwiki, itwiki, nlwiki, kowiki: Product-Analytics.
Oct 22 2019, 3:50 PM · Product-Analytics (Kanban), Chinese-Sites, Readers-Web-Backlog (Tracking)

Oct 21 2019

MNeisler moved T233888: Calculate baselines for project key results from Triage to Tracking on the Product-Analytics board.
Oct 21 2019, 5:13 PM · Product-Analytics, OWC2020
MNeisler moved T234046: Create OWC metric definitions from Doing to Tracking on the Product-Analytics board.
Oct 21 2019, 5:10 PM · Product-Analytics, VisualEditor (Current work), OWC2020
MNeisler edited projects for T234046: Create OWC metric definitions, added: Product-Analytics; removed Product-Analytics (Kanban).
Oct 21 2019, 5:09 PM · Product-Analytics, VisualEditor (Current work), OWC2020

Oct 18 2019

MNeisler added a comment to T234559: AMC KPI Report Q2 .

@ovasileva - A couple questions:

Oct 18 2019, 8:50 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking)
MNeisler moved T232118: How often do people log out on mobile? from Doing to Needs Review on the Product-Analytics (Kanban) board.
Oct 18 2019, 12:22 AM · Product-Analytics (Kanban), Advanced Mobile Contributions, Readers-Web-Backlog (Tracking)

Oct 15 2019

MNeisler claimed T234559: AMC KPI Report Q2 .
Oct 15 2019, 7:32 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking)
MNeisler moved T234559: AMC KPI Report Q2 from Triage to Doing on the Product-Analytics board.
Oct 15 2019, 7:32 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking)
MNeisler added a project to T234559: AMC KPI Report Q2 : Product-Analytics.
Oct 15 2019, 7:32 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking)
MNeisler added a comment to T232118: How often do people log out on mobile?.

Here are the results looking at the timeframe: 9/10/2019 - 10/13/2019

Oct 15 2019, 6:31 PM · Product-Analytics (Kanban), Advanced Mobile Contributions, Readers-Web-Backlog (Tracking)

Oct 10 2019

MNeisler added a comment to T234409: Define key result(s) for 2019–2020 fiscal year.

@ppelberg - Adding some thoughts re potential quantitative metrics below as I think through these. Happy to have a quick meeting if it's easier to figure these out synchronously instead.

Oct 10 2019, 10:18 PM · OWC2020

Oct 9 2019

MNeisler added a comment to T234046: Create OWC metric definitions.

1. Junior contributors
Notes

  • If we're not able to look at contributions on a per project basis, that would mean a contributor who has 200 edits to Commons and 2 edits to Wikipedia, would not be considered a junior contributor to wikipedia

Actions

  • @MNeisler: is it possible to differentiate contributions by project?
Oct 9 2019, 11:53 PM · Product-Analytics, VisualEditor (Current work), OWC2020
MNeisler added a comment to T233823: Mobile VE edit flow: instrumentation post-deployment data checks.

@DLynch - In QA, @Mayakp.wiki noticed the following mwSave feature actions were being recorded:

Oct 9 2019, 11:02 PM · Product-Analytics (Kanban), VisualEditor (Current work)
MNeisler moved T234563: Whitelist MobileWebUIActionsTracking data stream from Next Up to Review on the Product-Analytics board.
Oct 9 2019, 10:19 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking)
MNeisler added a comment to T234046: Create OWC metric definitions.

Noting some current thoughts/responses to the questions above:

Oct 9 2019, 2:44 PM · Product-Analytics, VisualEditor (Current work), OWC2020

Oct 7 2019

MNeisler moved T233261: Analyze "junior contributor" talk page participation from Doing to Review on the Product-Analytics board.
Oct 7 2019, 4:44 PM · Product-Analytics (Kanban), OWC2020
MNeisler moved T234046: Create OWC metric definitions from Triage to Doing on the Product-Analytics board.
Oct 7 2019, 4:35 PM · Product-Analytics, VisualEditor (Current work), OWC2020

Oct 3 2019

MNeisler updated the task description for T232118: How often do people log out on mobile?.
Oct 3 2019, 8:07 PM · Product-Analytics (Kanban), Advanced Mobile Contributions, Readers-Web-Backlog (Tracking)
MNeisler triaged T234563: Whitelist MobileWebUIActionsTracking data stream as High priority.
Oct 3 2019, 7:40 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking)
MNeisler created T234563: Whitelist MobileWebUIActionsTracking data stream.
Oct 3 2019, 7:39 PM · Product-Analytics (Kanban), Readers-Web-Backlog (Tracking)
MNeisler moved T223339: Re-run metrics from VE on mobile report from Next Up to Backlog on the Product-Analytics board.
Oct 3 2019, 7:38 PM · Product-Analytics, VisualEditor
MNeisler moved T226573: Graph edit completion rate over time from Next Up to Backlog on the Product-Analytics board.
Oct 3 2019, 7:37 PM · Product-Analytics, VisualEditor (Current work)
MNeisler added a comment to T234277: Decide how we move forward with the A/B test.

Resulting questions for @MNeisler:

  • What – if any – modifications do you think we should make to the test to properly answer our key question: "What editing interface makes for a "better" editing experience for newer contributors?"
    • e.g. Should edits that trigger abuse filters be excluded from our calculation of edit completion rate?
    • e.g. Should bot edits be excluded from our calculation of edit completion rate? Maybe this is moot considering there were ~43 edits tagged bot, mobile web edits and page edits in the past 30 days on en.wiki and thus they are not likely to impact the test results.
Oct 3 2019, 3:33 PM · VisualEditor (Current work), Epic

Oct 1 2019

MNeisler added a comment to T233823: Mobile VE edit flow: instrumentation post-deployment data checks.

Reassigning to @Mayakp.wiki, our Data Quality Analyst. I'll pair with her to perform the data checks.

Oct 1 2019, 8:58 PM · Product-Analytics (Kanban), VisualEditor (Current work)
MNeisler reassigned T233823: Mobile VE edit flow: instrumentation post-deployment data checks from MNeisler to Mayakp.wiki.
Oct 1 2019, 8:53 PM · Product-Analytics (Kanban), VisualEditor (Current work)

Sep 27 2019

MNeisler added a comment to T233261: Analyze "junior contributor" talk page participation.

Here's an updated chart showing year over year changes in the number of distinct junior contributors contributing to talk pages from August 2014 through August 2019.

Sep 27 2019, 12:32 AM · Product-Analytics (Kanban), OWC2020

Sep 25 2019

MNeisler updated the task description for T233261: Analyze "junior contributor" talk page participation.
Sep 25 2019, 6:34 PM · Product-Analytics (Kanban), OWC2020
MNeisler added a comment to T233261: Analyze "junior contributor" talk page participation.

@ppelberg - Documenting the decision from our meeting today - I will extend the analysis to see how the numbers vary over the past 5 years. I'll update the description to reflect the new scope.

Sep 25 2019, 6:31 PM · Product-Analytics (Kanban), OWC2020

Sep 24 2019

MNeisler moved T232118: How often do people log out on mobile? from Next Up to Doing on the Product-Analytics board.
Sep 24 2019, 4:39 PM · Product-Analytics (Kanban), Advanced Mobile Contributions, Readers-Web-Backlog (Tracking)
MNeisler moved T228167: Assess the mobile visual editor's loading performace from Next Up to Backlog on the Product-Analytics board.
Sep 24 2019, 4:36 PM · Product-Analytics, VisualEditor-MediaWiki-Mobile, VisualEditor
MNeisler moved T223499: Write query for Editing Team to access contributors makeup from Next Up to Backlog on the Product-Analytics board.
Sep 24 2019, 4:31 PM · Product-Analytics, VisualEditor
MNeisler moved T223498: Write query for Editing Team to access edit completion rate from Next Up to Backlog on the Product-Analytics board.
Sep 24 2019, 4:30 PM · Product-Analytics, VisualEditor
MNeisler added a comment to T232237: VE mobile default test buckets are unbalanced.

@MNeisler, are you able to share how our results and our confidence in them might be affected should we move forward with analyzing the data we've gathered so far?

I discussed this with @Neil_P._Quinn_WMF today. There are a couple potential ways we could correct for the identified issue in the analysis if we decided to proceed with analyzing the data as is.

  1. We could add in all the missing visual users treating them all as if they tried to use the editor but failed to load it. The problem with this approach is we don’t know if they were all different users or any other user details associated with these events. This also assumes that we are not missing any users for wikitext due to a load timing issue.
  2. We could subtract randomly selected init sessions from the wikitext bucket to bring the bucket numbers in line. This might artificially increase the edit completion rate a little but would avoid us having to make assumptions about the missing user data.
Sep 24 2019, 4:25 PM · Product-Analytics (Kanban), MW-1.35-notes (1.35.0-wmf.1; 2019-10-08), VisualEditor (Current work), VisualEditor-MediaWiki-Mobile

Sep 23 2019

MNeisler updated subscribers of T230367: Edit Cards v3: instrumentation post-deployment data checks.

I reviewed the data and confirmed that we are logging events as expected for when a contributor types text into the "Text" field within "Wikipedia" or "External site" panel/tab. These events are
logged as: “mf.schemaVisualEditorFeatureUse {feature: "link", action: "label-input", editingSessionId: "..."}”.

Sep 23 2019, 9:50 PM · User-Ryasmeen, Product-Analytics, VisualEditor-MediaWiki-Mobile, VisualEditor

Sep 20 2019

MNeisler added a comment to T233261: Analyze "junior contributor" talk page participation.

I looked at junior contributors (<100 cumulative edits) talk page participation for the identified time periods. I removed editors tagged with a bot flag.

Sep 20 2019, 5:56 PM · Product-Analytics (Kanban), OWC2020

Sep 18 2019

MNeisler triaged T233261: Analyze "junior contributor" talk page participation as High priority.
Sep 18 2019, 11:29 PM · Product-Analytics (Kanban), OWC2020
marcella awarded T232237: VE mobile default test buckets are unbalanced a Cookie token.
Sep 18 2019, 4:04 PM · Product-Analytics (Kanban), MW-1.35-notes (1.35.0-wmf.1; 2019-10-08), VisualEditor (Current work), VisualEditor-MediaWiki-Mobile

Sep 17 2019

MNeisler moved T230367: Edit Cards v3: instrumentation post-deployment data checks from Blocked / Stalled to Doing on the Product-Analytics board.
Sep 17 2019, 8:54 PM · User-Ryasmeen, Product-Analytics, VisualEditor-MediaWiki-Mobile, VisualEditor
MNeisler added a comment to T232237: VE mobile default test buckets are unbalanced.

I spent some time yesterday digging into the data to determine if the imbalance was present for any particular subgroup. See summary of findings so far below and full results linked here:

Sep 17 2019, 8:47 PM · Product-Analytics (Kanban), MW-1.35-notes (1.35.0-wmf.1; 2019-10-08), VisualEditor (Current work), VisualEditor-MediaWiki-Mobile

Sep 13 2019

MNeisler moved T232237: VE mobile default test buckets are unbalanced from Next Up to Doing on the Product-Analytics board.
Sep 13 2019, 6:43 PM · Product-Analytics (Kanban), MW-1.35-notes (1.35.0-wmf.1; 2019-10-08), VisualEditor (Current work), VisualEditor-MediaWiki-Mobile
MNeisler closed T220016: Create, and deploy working MobileWebUIActionsTracking schema, a subtask of T226068: AMC Outreach - Modal, as Resolved.
Sep 13 2019, 6:33 PM · MW-1.34-notes (1.34.0-wmf.20; 2019-08-27), Readers-Web-Backlog (Readers-Web-Kanbanana-2019-20-Q1), Advanced Mobile Contributions