Page MenuHomePhabricator

nettrom_WMF (Morten Warncke-Wang)
Data Analyst, Product Analytics

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Thursday

  • Clear sailing ahead.

User Details

User Since
Aug 21 2018, 8:23 PM (60 w, 6 d)
Availability
Available
IRC Nick
Nettrom
LDAP User
Unknown
MediaWiki User
MWang (WMF) [ Global Accounts ]

Recent Activity

Yesterday

nettrom_WMF triaged T235577: Homepage: ensure data retention is in line with the guideline exception as Normal priority.
Mon, Oct 21, 5:14 PM · Growth-Team, Analytics, GrowthExperiments, Product-Analytics

Wed, Oct 16

nettrom_WMF moved T235553: Newcomer Tasks: baseline revert rate of newcomer edits from Doing to Needs Review on the Product-Analytics (Kanban) board.
Wed, Oct 16, 10:46 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF reassigned T235553: Newcomer Tasks: baseline revert rate of newcomer edits from nettrom_WMF to MMiller_WMF.

I grabbed data for users who registered on the given wikis between Sept 2018 and Sept 2019 for our four target wikis (Czech, Korean, Vietnamese, and Arabic) using the mediawiki_history table in the Data Lake. This allows for 14 days of editing after registration, as well as 48 hours for a revert to occur. Auto-created accounts and accounts created by others were excluded, as were any accounts identified as bots. For specifics, the notebook is on GitHub.

Wed, Oct 16, 10:46 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF moved T227239: Help panel: hierarchical analysis from Needs Review to Next Up on the Product-Analytics (Kanban) board.
Wed, Oct 16, 7:35 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)

Tue, Oct 15

nettrom_WMF moved T235553: Newcomer Tasks: baseline revert rate of newcomer edits from Ready for Development to In Progress on the Growth-Team (Current Sprint) board.
Tue, Oct 15, 11:21 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF moved T235553: Newcomer Tasks: baseline revert rate of newcomer edits from Triage to Doing on the Product-Analytics board.
Tue, Oct 15, 11:20 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF placed T235577: Homepage: ensure data retention is in line with the guideline exception up for grabs.
Tue, Oct 15, 11:18 PM · Growth-Team, Analytics, GrowthExperiments, Product-Analytics
nettrom_WMF moved T235577: Homepage: ensure data retention is in line with the guideline exception from Inbox to FY 2019-20 on the Growth-Team board.
Tue, Oct 15, 11:18 PM · Growth-Team, Analytics, GrowthExperiments, Product-Analytics
nettrom_WMF created T235577: Homepage: ensure data retention is in line with the guideline exception.
Tue, Oct 15, 11:17 PM · Growth-Team, Analytics, GrowthExperiments, Product-Analytics
nettrom_WMF created T235553: Newcomer Tasks: baseline revert rate of newcomer edits.
Tue, Oct 15, 7:51 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF placed T232396: Newcomer tasks: align treatment groups up for grabs.
Tue, Oct 15, 7:32 PM · Product-Analytics (Kanban), NewcomerTasks 1.0 , Growth-Team (Current Sprint), GrowthExperiments-Homepage
nettrom_WMF added a project to T208369: Welcome survey: anonymize data after one year: Product-Analytics.
Tue, Oct 15, 6:00 PM · Product-Analytics, Growth-Team (Current Sprint)
nettrom_WMF closed T234870: Help panel: delete sanitized data from before Oct 1 as Resolved.

@mforns : thanks for taking care of this! I've verified that the table doesn't contain any data prior to Oct 1st. Everything looks good here, so I'm closing this.

Tue, Oct 15, 3:57 PM · Analytics-Kanban, Analytics, Product-Analytics, Growth-Team (Current Sprint)
nettrom_WMF closed T234870: Help panel: delete sanitized data from before Oct 1, a subtask of T206720: Help panel: experiments, as Resolved.
Tue, Oct 15, 3:57 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF closed T234857: Homepage: back up HelpPanel data, a subtask of T217803: Homepage: experiment, as Resolved.
Tue, Oct 15, 3:55 PM · Product-Analytics (Kanban), GrowthExperiments-Homepage, Growth-Team (Current Sprint)
nettrom_WMF closed T234857: Homepage: back up HelpPanel data as Resolved.

This work is done.

Tue, Oct 15, 3:55 PM · Product-Analytics, Growth-Team (Current Sprint)
nettrom_WMF removed Due Date on T217803: Homepage: experiment.
Tue, Oct 15, 2:26 PM · Product-Analytics (Kanban), GrowthExperiments-Homepage, Growth-Team (Current Sprint)
nettrom_WMF removed Due Date on T227239: Help panel: hierarchical analysis.
Tue, Oct 15, 2:26 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)

Mon, Oct 14

nettrom_WMF added a comment to T206720: Help panel: experiments.

@Aklapper : thanks for the ping on this! This task should still be open as we've got a couple of related tasks open, once they are resolved I'll make sure to close this task as well. I've removed the deadline date since that's no longer relevant.

Mon, Oct 14, 4:10 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF removed Due Date on T206720: Help panel: experiments.
Mon, Oct 14, 4:08 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)

Thu, Oct 10

nettrom_WMF added a comment to T234870: Help panel: delete sanitized data from before Oct 1.

@fdans : Can confirm that the range to be deleted is the beginning of time (which is like April 2019) up to Oct 1. And yes, all fields are to be deleted. Thanks!

Thu, Oct 10, 5:58 PM · Analytics-Kanban, Analytics, Product-Analytics, Growth-Team (Current Sprint)

Tue, Oct 8

nettrom_WMF triaged T234870: Help panel: delete sanitized data from before Oct 1 as High priority.
Tue, Oct 8, 5:58 PM · Analytics-Kanban, Analytics, Product-Analytics, Growth-Team (Current Sprint)
nettrom_WMF added a comment to T234870: Help panel: delete sanitized data from before Oct 1.

The second part of this, me deleting the initial set of data has been done:

Tue, Oct 8, 12:16 AM · Analytics-Kanban, Analytics, Product-Analytics, Growth-Team (Current Sprint)
nettrom_WMF moved T234870: Help panel: delete sanitized data from before Oct 1 from Triage to Doing on the Product-Analytics board.
Tue, Oct 8, 12:12 AM · Analytics-Kanban, Analytics, Product-Analytics, Growth-Team (Current Sprint)
nettrom_WMF moved T234870: Help panel: delete sanitized data from before Oct 1 from Incoming to In Progress on the Growth-Team (Current Sprint) board.
Tue, Oct 8, 12:12 AM · Analytics-Kanban, Analytics, Product-Analytics, Growth-Team (Current Sprint)
nettrom_WMF added a subtask for T206720: Help panel: experiments: T234870: Help panel: delete sanitized data from before Oct 1.
Tue, Oct 8, 12:12 AM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF added a parent task for T234870: Help panel: delete sanitized data from before Oct 1: T206720: Help panel: experiments.
Tue, Oct 8, 12:12 AM · Analytics-Kanban, Analytics, Product-Analytics, Growth-Team (Current Sprint)
nettrom_WMF created T234870: Help panel: delete sanitized data from before Oct 1.
Tue, Oct 8, 12:11 AM · Analytics-Kanban, Analytics, Product-Analytics, Growth-Team (Current Sprint)
nettrom_WMF closed T234855: Remove the HelpPanel schema from the EventLogging whitelist, a subtask of T206720: Help panel: experiments, as Declined.
Tue, Oct 8, 12:01 AM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF closed T234855: Remove the HelpPanel schema from the EventLogging whitelist as Declined.

This makes no sense as we'd probably just ask to whitelist it again in a month's time. Declining.

Tue, Oct 8, 12:01 AM · Analytics, Product-Analytics, Growth-Team (Current Sprint)

Mon, Oct 7

nettrom_WMF added a subtask for T217803: Homepage: experiment: T234857: Homepage: back up HelpPanel data.
Mon, Oct 7, 9:10 PM · Product-Analytics (Kanban), GrowthExperiments-Homepage, Growth-Team (Current Sprint)
nettrom_WMF added a parent task for T234857: Homepage: back up HelpPanel data: T217803: Homepage: experiment.
Mon, Oct 7, 9:10 PM · Product-Analytics, Growth-Team (Current Sprint)
nettrom_WMF added a comment to T234857: Homepage: back up HelpPanel data.

Ran the following query to back up the data:

Mon, Oct 7, 9:10 PM · Product-Analytics, Growth-Team (Current Sprint)
nettrom_WMF created T234857: Homepage: back up HelpPanel data.
Mon, Oct 7, 8:29 PM · Product-Analytics, Growth-Team (Current Sprint)
nettrom_WMF moved T234855: Remove the HelpPanel schema from the EventLogging whitelist from Triage to Doing on the Product-Analytics board.
Mon, Oct 7, 8:24 PM · Analytics, Product-Analytics, Growth-Team (Current Sprint)
nettrom_WMF triaged T234855: Remove the HelpPanel schema from the EventLogging whitelist as High priority.
Mon, Oct 7, 8:24 PM · Analytics, Product-Analytics, Growth-Team (Current Sprint)
nettrom_WMF added a subtask for T206720: Help panel: experiments: T234855: Remove the HelpPanel schema from the EventLogging whitelist.
Mon, Oct 7, 8:23 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF added a parent task for T234855: Remove the HelpPanel schema from the EventLogging whitelist: T206720: Help panel: experiments.
Mon, Oct 7, 8:23 PM · Analytics, Product-Analytics, Growth-Team (Current Sprint)
nettrom_WMF created T234855: Remove the HelpPanel schema from the EventLogging whitelist.
Mon, Oct 7, 8:20 PM · Analytics, Product-Analytics, Growth-Team (Current Sprint)
nettrom_WMF moved T232396: Newcomer tasks: align treatment groups from Triage to Doing on the Product-Analytics board.
Mon, Oct 7, 8:02 PM · Product-Analytics (Kanban), NewcomerTasks 1.0 , Growth-Team (Current Sprint), GrowthExperiments-Homepage
nettrom_WMF triaged T232396: Newcomer tasks: align treatment groups as Normal priority.
Mon, Oct 7, 8:02 PM · Product-Analytics (Kanban), NewcomerTasks 1.0 , Growth-Team (Current Sprint), GrowthExperiments-Homepage
nettrom_WMF added a project to T232396: Newcomer tasks: align treatment groups: Product-Analytics.

One aspect around this that has come up during the work on the Newcomer Tasks measurement plan is how we handle A/B testing variants of the intervention for existing users. We'll be discussing that in the team and see what we end up with.

Mon, Oct 7, 8:01 PM · Product-Analytics (Kanban), NewcomerTasks 1.0 , Growth-Team (Current Sprint), GrowthExperiments-Homepage

Thu, Oct 3

nettrom_WMF moved T232406: Welcome survey: modifications to the "Getting started with editing" box from Next Up to Review on the Product-Analytics board.
Thu, Oct 3, 9:10 PM · Growth-Team, GrowthExperiments
nettrom_WMF reassigned T232406: Welcome survey: modifications to the "Getting started with editing" box from nettrom_WMF to MMiller_WMF.

I used the current dataset from EditorJourney (last 90 days). For each of the three wikis where the Welcome Survey is deployed, I count the number of views of the survey (rather than registrations, because users can go back to the survey and access the links), as well as the number of views of the Tutorial and Help Desk pages. For the latter two, I only count views that have source=survey in the request to identify views that originated from the Welcome Survey. I counted the Tutorial and Help Desk links separately, and also split between views on Desktop and Mobile as requested. Finally, I calculate % of clicks on these links relative to the number of views of the Welcome Survey. The results are as follows:

Thu, Oct 3, 9:10 PM · Growth-Team, GrowthExperiments

Wed, Oct 2

nettrom_WMF moved T226558: Performance review of hover-in/out event logging in GrowthExperiments Special:Homepage from Triage to Icebox on the Product-Analytics board.

Moving this to the Icebox on the Product Analytics board. Not sure when/if this is going to be an issue (we're currently nowhere near danger territory at 20–30 events/sec being the higher end of the dataset). Adding @MMiller_WMF to the subscriber list as well as I figured he should learn if something changes here.

Wed, Oct 2, 5:54 PM · Performance-Team (Radar), Product-Analytics, Growth-Team, GrowthExperiments-Homepage
nettrom_WMF claimed T226558: Performance review of hover-in/out event logging in GrowthExperiments Special:Homepage.
Wed, Oct 2, 12:09 AM · Performance-Team (Radar), Product-Analytics, Growth-Team, GrowthExperiments-Homepage

Tue, Oct 1

nettrom_WMF added a comment to T222926: Use preferences for inputting email address.

@Tgr : likewise, thanks for letting me know about these changes. I don't have any current analysis or reporting that will be affected, so we're good there as well. (My main concern was Marshall's reports, but since he already checked those all is well)

Tue, Oct 1, 11:44 PM · MW-1.34-notes (1.34.0-wmf.25; 2019-10-01), GrowthExperiments-Help panel, GrowthExperiments-HelpModule, Mobile, Desktop, GrowthExperiments-MentorshipModule, GrowthExperiments-Homepage, Growth-Team (Current Sprint)

Mon, Sep 30

nettrom_WMF reassigned T230068: Newcomer tasks: instrumentation from nettrom_WMF to MMiller_WMF.

Draft measurement plan has been created, reassigning to @MMiller_WMF for reviews and revisions.

Mon, Sep 30, 5:31 PM · Epic, Product-Analytics (Kanban), Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage

Sat, Sep 28

Krinkle awarded T234084: EditorJourney records revision IDs for diffs a Love token.
Sat, Sep 28, 1:44 AM · MediaWiki-extensions-WikimediaEvents, MW-1.34-notes (1.34.0-wmf.25; 2019-10-01), Growth-Team (Current Sprint)

Fri, Sep 27

nettrom_WMF moved T233065: Deploy Help Panel to Basque Wikipedia from Triage to Blocked / Stalled on the Product-Analytics board.

@Mayakp.wiki has led the QA work on this, thanks for helping out!

Fri, Sep 27, 10:13 PM · Product-Analytics (Kanban), GrowthExperiments, Growth-Team (Current Sprint)
nettrom_WMF added a project to T233065: Deploy Help Panel to Basque Wikipedia: Product-Analytics.
Fri, Sep 27, 10:09 PM · Product-Analytics (Kanban), GrowthExperiments, Growth-Team (Current Sprint)
nettrom_WMF closed T232061: Deploy EditorJourney to Basque Wikipedia as Resolved.

Verified that the obfuscated namespaces are indeed obfuscated, and that the others are not. We don't have any data longer than 24 hours. Also spot-checked the dataset and didn't see anything of concern. Closing as resolved.

Fri, Sep 27, 8:26 PM · Product-Analytics, GrowthExperiments, Growth-Team (Current Sprint)
nettrom_WMF closed T232061: Deploy EditorJourney to Basque Wikipedia, a subtask of T232060: Deploy Growth features to Basque Wikipedia, as Resolved.
Fri, Sep 27, 8:26 PM · GrowthExperiments, Growth-Team (Current Sprint)
nettrom_WMF added a project to T232061: Deploy EditorJourney to Basque Wikipedia: Product-Analytics.
Fri, Sep 27, 8:24 PM · Product-Analytics, GrowthExperiments, Growth-Team (Current Sprint)
nettrom_WMF created T234084: EditorJourney records revision IDs for diffs.
Fri, Sep 27, 6:23 PM · MediaWiki-extensions-WikimediaEvents, MW-1.34-notes (1.34.0-wmf.25; 2019-10-01), Growth-Team (Current Sprint)
nettrom_WMF moved T232406: Welcome survey: modifications to the "Getting started with editing" box from Triage to Next Up on the Product-Analytics board.
Fri, Sep 27, 5:16 PM · Growth-Team, GrowthExperiments
nettrom_WMF triaged T232406: Welcome survey: modifications to the "Getting started with editing" box as Normal priority.
Fri, Sep 27, 5:16 PM · Growth-Team, GrowthExperiments
nettrom_WMF moved T233063: Deploy welcome survey to Basque Wikipedia from Triage to Next Up on the Product-Analytics board.
Fri, Sep 27, 5:15 PM · Product-Analytics (Kanban), GrowthExperiments, Growth-Team (Current Sprint)
nettrom_WMF triaged T233063: Deploy welcome survey to Basque Wikipedia as Normal priority.
Fri, Sep 27, 5:15 PM · Product-Analytics (Kanban), GrowthExperiments, Growth-Team (Current Sprint)
nettrom_WMF added a comment to T230068: Newcomer tasks: instrumentation.

The draft measurement plan is being worked on, so I've claimed this task, updated tags, and moved it to the right columns.

Fri, Sep 27, 12:24 AM · Epic, Product-Analytics (Kanban), Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage
nettrom_WMF updated the task description for T230068: Newcomer tasks: instrumentation.
Fri, Sep 27, 12:23 AM · Epic, Product-Analytics (Kanban), Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage
nettrom_WMF moved T230068: Newcomer tasks: instrumentation from Triage to Doing on the Product-Analytics board.
Fri, Sep 27, 12:23 AM · Epic, Product-Analytics (Kanban), Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage
nettrom_WMF claimed T230068: Newcomer tasks: instrumentation.
Fri, Sep 27, 12:23 AM · Epic, Product-Analytics (Kanban), Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage
nettrom_WMF triaged T230068: Newcomer tasks: instrumentation as Normal priority.
Fri, Sep 27, 12:23 AM · Epic, Product-Analytics (Kanban), Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage

Wed, Sep 25

nettrom_WMF added a comment to T231605: [REQUEST] Research into usefulness of edits made by IP editors.

@Niharika : I've updated the Research page on Meta with data on reverts, revdeletions, and subsequent blocks across all projects.

Wed, Sep 25, 4:35 PM · Product-Analytics (Kanban), Anti-Harassment
nettrom_WMF triaged T232061: Deploy EditorJourney to Basque Wikipedia as Normal priority.
Wed, Sep 25, 4:24 PM · Product-Analytics, GrowthExperiments, Growth-Team (Current Sprint)
nettrom_WMF triaged T233065: Deploy Help Panel to Basque Wikipedia as Normal priority.
Wed, Sep 25, 4:24 PM · Product-Analytics (Kanban), GrowthExperiments, Growth-Team (Current Sprint)
nettrom_WMF triaged T233066: Deploy Newcomer Homepage to Basque Wikipedia as Normal priority.
Wed, Sep 25, 4:24 PM · GrowthExperiments, Growth-Team (Current Sprint)

Tue, Sep 24

nettrom_WMF added a comment to T233363: New verification emails unexpectedly enabled on cswiki, kowiki, arwiki, viwiki.

As done in the previous comments (which I've deleted due to them using erroneous data), I decided to reuse the code and graphs we had for our analysis around emails (T204785), where we got proportion of registrations. In order to reflect any changes around deployment of the Homepage to Czech and Korean Wikipedias in May, the data gathering starts on 2019-01-01. Auto-created accounts are excluded from the analysis.

Tue, Sep 24, 9:35 PM · Product-Analytics (Kanban), Growth-Team, GrowthExperiments
nettrom_WMF closed T233749: Investigate changes in email verification around June 1, 2019, a subtask of T233363: New verification emails unexpectedly enabled on cswiki, kowiki, arwiki, viwiki, as Resolved.
Tue, Sep 24, 9:22 PM · Product-Analytics (Kanban), Growth-Team, GrowthExperiments
nettrom_WMF closed T233749: Investigate changes in email verification around June 1, 2019 as Resolved.

Investigating this further revealed that this was an error in the underlying query that gathered the data. On 2019-06-03, a switch was made in how the logging table stored the user ID of an account creation, from storing that in the log_user column to instead storing it indirectly through a reference (log_actor) to the actor table. Updating the query to follow this new convention results in graphs that show particular change around this period. I'll follow up in the parent task with updated graphs and analysis.

Tue, Sep 24, 9:22 PM · Product-Analytics, Growth-Team (Current Sprint)
nettrom_WMF updated the task description for T233749: Investigate changes in email verification around June 1, 2019.
Tue, Sep 24, 8:32 PM · Product-Analytics, Growth-Team (Current Sprint)
nettrom_WMF added a subtask for T233363: New verification emails unexpectedly enabled on cswiki, kowiki, arwiki, viwiki: T233749: Investigate changes in email verification around June 1, 2019.
Tue, Sep 24, 6:14 PM · Product-Analytics (Kanban), Growth-Team, GrowthExperiments
nettrom_WMF added a parent task for T233749: Investigate changes in email verification around June 1, 2019: T233363: New verification emails unexpectedly enabled on cswiki, kowiki, arwiki, viwiki.
Tue, Sep 24, 6:14 PM · Product-Analytics, Growth-Team (Current Sprint)
nettrom_WMF triaged T233749: Investigate changes in email verification around June 1, 2019 as High priority.
Tue, Sep 24, 6:13 PM · Product-Analytics, Growth-Team (Current Sprint)
nettrom_WMF moved T233749: Investigate changes in email verification around June 1, 2019 from Incoming to Ready for Development on the Growth-Team (Current Sprint) board.
Tue, Sep 24, 6:13 PM · Product-Analytics, Growth-Team (Current Sprint)
nettrom_WMF created T233749: Investigate changes in email verification around June 1, 2019.
Tue, Sep 24, 6:12 PM · Product-Analytics, Growth-Team (Current Sprint)
nettrom_WMF added a comment to T233363: New verification emails unexpectedly enabled on cswiki, kowiki, arwiki, viwiki.

Here are updated versions of the graphs going back to Jan 1, so we get a few months of data before the initial release of the Homepage to Czech and Korean. As far as I can tell, there's no indication that the release of the Homepage (in May on Czech and Korean, and in July on Vietnamese and Arabic) has had a clear impact on email verification. That being said, this data contains the current state of all users email addresses. We can restrict it to those who provided one within a certain amount of time after registration to see if time plays a role. Secondly, the impact of the Homepage might be possible to detect, but it might also be small.

Tue, Sep 24, 12:46 AM · Product-Analytics (Kanban), Growth-Team, GrowthExperiments

Sep 20 2019

nettrom_WMF moved T233363: New verification emails unexpectedly enabled on cswiki, kowiki, arwiki, viwiki from Triage to Review on the Product-Analytics board.
Sep 20 2019, 8:46 PM · Product-Analytics (Kanban), Growth-Team, GrowthExperiments
nettrom_WMF added a project to T233363: New verification emails unexpectedly enabled on cswiki, kowiki, arwiki, viwiki: Product-Analytics.

[comment deleted due to graphs using erroneous data, see updated comment below]

Sep 20 2019, 8:45 PM · Product-Analytics (Kanban), Growth-Team, GrowthExperiments

Sep 18 2019

nettrom_WMF added a comment to T232400: Newcomer tasks: welcome survey changes.

@nettrom_WMF -- I think it is possible that these lines affect a user's motivation, but I don't know whether it will decrease or increase it. On the one hand, it sounds like a less altruistic motivation (to help yourself instead of others), but on the other hand it sounds like there's more in it for you. Given that I'm not sure which way it would go, I think it's better to try to make these statements cleave as closely as possible to the reality of how we're using the responses.
But are you saying that the lines as I wrote them give some information, but not enough, about how the responses will be used, and being in that limbo zone could be a turn-off? If so, how do you recommend we approach it?

Sep 18 2019, 11:31 PM · MW-1.34-notes (1.34.0-wmf.25; 2019-10-01), NewcomerTasks 1.0 , Growth-Team (Current Sprint), GrowthExperiments-Homepage
nettrom_WMF reassigned T227239: Help panel: hierarchical analysis from nettrom_WMF to MMiller_WMF.

We have a set of slides for sharing this with stakeholders, reassigning to @MMiller_WMF for review.

Sep 18 2019, 11:25 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF updated subscribers of T226861: Hash all pageTokens or temporary identifiers from the EL Sanitization white-list for Community Tech.

@ifried or @aezell : not sure which one of you to contact, so I'm pinging you both, sorry! Would be great if someone on the team can review this. If the team has any EventLogging schemas that are whitelisted, and said whitelisting stores a token, a patch of the whitelist should be created to hash related tokens.

Sep 18 2019, 11:20 PM · Product-Analytics (Kanban), Community-Tech, Analytics
nettrom_WMF closed T226853: Hash all pageTokens or temporary identifiers from the EL Sanitization white-list for AHT, a subtask of T220410: Hash all pageTokens or temporary identifiers from the EL Sanitization white-list, as Resolved.
Sep 18 2019, 11:17 PM · VisualEditor, Product-Analytics, Analytics
nettrom_WMF closed T226853: Hash all pageTokens or temporary identifiers from the EL Sanitization white-list for AHT as Resolved.

Schema:AutoblockIpBlock is not whitelisted, so if that is the only schema that this team is connected to, then no hashing is needed. I'm closing this as resolved, please reopen if necessary.

Sep 18 2019, 11:17 PM · Anti-Harassment, Product-Analytics, Analytics
nettrom_WMF added a comment to T201656: Growth: 2018-2019 annual plan metrics report.

@MMiller_WMF : given that we've had the Year in Review, can we close this task?

Sep 18 2019, 11:15 PM · Growth-Team, Product-Analytics
nettrom_WMF reassigned T228338: Homepage: discovery measurement from nettrom_WMF to MMiller_WMF.

As far as I'm concerned my part of this is now done, so reassigning to @MMiller_WMF for review.

Sep 18 2019, 9:39 PM · Growth-Team (Current Sprint), Product-Analytics, GrowthExperiments-HomepageDiscovery, GrowthExperiments-Homepage
nettrom_WMF added a comment to T228338: Homepage: discovery measurement.

Forgot the second part of this analysis. In this case, I'm using data from the final deployment (26 July) and 4 weeks onwards. All registrations are counted, and the visit_mobile flag below shows whether the first visit was on the mobile (True) or desktop (False) site. Again visits have to occur within 48 hours of registration. Percentages are calculated within each group (wiki and desktop/mobile).

Sep 18 2019, 12:47 AM · Growth-Team (Current Sprint), Product-Analytics, GrowthExperiments-HomepageDiscovery, GrowthExperiments-Homepage
nettrom_WMF added a comment to T228338: Homepage: discovery measurement.

@MMiller_WMF : thanks for asking about why the numbers are different. I went back and had another look at the leading indicators, and then found that I'd forgotten to exclude the control group from the denominator in the current analysis. I'll update the numbers in a minute (spoiler alert: we're still above 100% increase on both wikis).

Sep 18 2019, 12:06 AM · Growth-Team (Current Sprint), Product-Analytics, GrowthExperiments-HomepageDiscovery, GrowthExperiments-Homepage

Sep 17 2019

nettrom_WMF added a comment to T228338: Homepage: discovery measurement.

I grabbed data from Czech and Korean Wikipedias for June, July, and August. Excluded from the analysis are auto-created accounts, known test accounts, and users who turned the Homepage on or off in their preferences. From this, I calculated a daily proportion of registrations that visited the Homepage within 48 hours after registration, and excluded the last two days of registrations to allow everyone equal opportunity.

Sep 17 2019, 9:58 PM · Growth-Team (Current Sprint), Product-Analytics, GrowthExperiments-HomepageDiscovery, GrowthExperiments-Homepage
nettrom_WMF added a comment to T232400: Newcomer tasks: welcome survey changes.

@MMiller_WMF : while I'm unsure how many users actually read these, I'm wondering if we're sure that this won't affect their motivation to respond? Partly because it's not clear how we're using these answers to improve their experience. And secondly, we might be benefiting from a generally positive view of Wikipedia when it comes to willingness to respond.

Sep 17 2019, 12:25 AM · MW-1.34-notes (1.34.0-wmf.25; 2019-10-01), NewcomerTasks 1.0 , Growth-Team (Current Sprint), GrowthExperiments-Homepage

Sep 13 2019

nettrom_WMF added a comment to T231605: [REQUEST] Research into usefulness of edits made by IP editors.

Here's another update: I looked into matching IPs against blocks, and I can do this across the entire dataset in the Data Lake instead of using the replicated databases. This means that I should be able to identify the proportion of IP edits that were subsequently blocked for all wikis that we have data for. Will continue working on that next week.

Sep 13 2019, 10:14 PM · Product-Analytics (Kanban), Anti-Harassment
nettrom_WMF added a comment to T232396: Newcomer tasks: align treatment groups.

I think what we do here depends on whether we see Newcomer Tasks as a new experiment or a continuation of the existing Homepage experiment. If we see it as a continuation, then I'm primarily concerned about the users who are currently in the Homepage treatment group, and I'd then turn on the Help Panel for all of those so they can get the new features.

Sep 13 2019, 6:51 PM · Product-Analytics (Kanban), NewcomerTasks 1.0 , Growth-Team (Current Sprint), GrowthExperiments-Homepage

Sep 12 2019

nettrom_WMF added a comment to T231605: [REQUEST] Research into usefulness of edits made by IP editors.

@Niharika : I've updated the page on meta with stats split up by project group (wikisource, wikibooks, etc), and for each language within that group. In addition to monthly averages for number of IP edits, I've also added min/max percentages of IP contributions for each of the 12 months in the dataset, so it's possible to see to what degree the proportion of IP edits varies across a year. I think that should be sufficient to answer the first question in this task.

Sep 12 2019, 5:57 PM · Product-Analytics (Kanban), Anti-Harassment
nettrom_WMF added a comment to T232400: Newcomer tasks: welcome survey changes.

@MMiller_WMF : I just noticed T211446 is still open. How do these two tasks relate to each other, is T211446 a blocker for this one?

Sep 12 2019, 4:12 PM · MW-1.34-notes (1.34.0-wmf.25; 2019-10-01), NewcomerTasks 1.0 , Growth-Team (Current Sprint), GrowthExperiments-Homepage

Sep 11 2019

nettrom_WMF removed Due Date on T216672: EditorJourney and Welcome Survey: second report.
Sep 11 2019, 9:41 PM · Product-Analytics, Growth-Team (Current Sprint)
nettrom_WMF added a comment to T232548: Homepage: remove question-asking from help module.

@MMiller_WMF : given the low usage and that we're only removing parts of the Help Panel feature (the question asking ability) rather than the entire panel, I don't see this having major impact on our Homepage experiment, so it can happen whenever the engineers feel like picking it up.

Sep 11 2019, 4:47 PM · MW-1.34-notes (1.34.0-wmf.25; 2019-10-01), GrowthExperiments-Homepage, GrowthExperiments-HelpModule, Growth-Team (Current Sprint)
nettrom_WMF added a comment to T232400: Newcomer tasks: welcome survey changes.

@MMiller_WMF : I don't see this interfere with anything that's currently going on, no. We don't have any experiments relying on those answers, and we've got about a couple of months of data from Arabic at this point, which should provide us with stability in responses there. Feel free to have an engineer pick it up.

Sep 11 2019, 4:39 PM · MW-1.34-notes (1.34.0-wmf.25; 2019-10-01), NewcomerTasks 1.0 , Growth-Team (Current Sprint), GrowthExperiments-Homepage

Sep 6 2019

nettrom_WMF moved T231605: [REQUEST] Research into usefulness of edits made by IP editors from Next Up to Doing on the Product-Analytics board.

@Niharika : I've started working on the first part of this, and am wondering if there's a particular place or format you'd want for the results? Maybe there's a wiki page somewhere that could contain the tables as wiki-tables, so it's easy to refer to in discussions?

Sep 6 2019, 8:51 PM · Product-Analytics (Kanban), Anti-Harassment
nettrom_WMF added a comment to T232171: event_user_id is always NULL for anonymous edits in Mediawiki History table.

@JAllemandou : Thanks for the quick turnaround, the excellent explanation, and for updating the documentation, very much appreciated!

Sep 6 2019, 6:29 PM · Analytics-Kanban, Product-Analytics, Analytics