Page MenuHomePhabricator

nettrom_WMF (Morten Warncke-Wang)
Staff Data Scientist, Product Analytics

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Monday

  • Clear sailing ahead.

User Details

User Since
Aug 21 2018, 8:23 PM (153 w, 3 d)
Availability
Available
IRC Nick
Nettrom
LDAP User
Unknown
MediaWiki User
MWang (WMF) [ Global Accounts ]

Recent Activity

Yesterday

nettrom_WMF moved T286002: Donors to newcomers: baseline constructive activation from Needs Investigation to Next 2 weeks on the Product-Analytics (Kanban) board.
Fri, Jul 30, 11:55 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)

Thu, Jul 29

nettrom_WMF updated subscribers of T287121: Add geolocation information to Growth schemas.

@mewoph : Can we add the reference to client_ip to https://gerrit.wikimedia.org/r/c/schemas/event/secondary/+/704402 so we also get that done and only have one version change to the schema? Based on the code for VirtualPageview that @Ottomata mentions above, all that should be needed is to add - $ref: /fragment/http/client_ip/1.0.0# to the referenced fragments.

Thu, Jul 29, 11:27 PM · Analytics-Radar, Growth-Team (Current Sprint), Product-Analytics
nettrom_WMF added a comment to T287404: Add a link: [Mobile]: Allow link inspector to be toggled shown/hidden.

Hi @nettrom_WMF, would these additions make sense?

  • close with active_interface=recommendedlinktoolbar_dialog for when the user clicks outside the link inspector to close it
  • impression with active_interface=recommendedlinktoolbar_dialog for re-opening the link inspector
  • reopen_dialog_click for clicking on the robot button --- for this, would machinesuggestions_mode make more sense for active_interface since recommendedlinktoolbar_dialog isn't shown?
Thu, Jul 29, 9:42 PM · Patch-For-Review, Growth-Team (Current Sprint), Add-Link, GrowthExperiments
nettrom_WMF added a comment to T287404: Add a link: [Mobile]: Allow link inspector to be toggled shown/hidden.
  • For instrumentation, do we need new events for these new actions? Are there any other things that need to be instrumented?
    • Closing the link inspector
    • Clicking on the robot button
    • Re-opening the link inspector
Thu, Jul 29, 6:32 PM · Patch-For-Review, Growth-Team (Current Sprint), Add-Link, GrowthExperiments

Mon, Jul 26

nettrom_WMF added a comment to T287210: EchoMail and EchoInteraction Event Platform Migration.

@nettrom_WMF @MMiller_WMF Do either EchoMail or EchoInteraction need client_ip and/or geocoded data?

Mon, Jul 26, 9:15 PM · MW-1.37-notes (1.37.0-wmf.17; 2021-08-02), Analytics-Kanban, Patch-For-Review, Analytics, Event-Platform

Fri, Jul 23

nettrom_WMF closed T275172: Growth: update welcome survey aggregation schedule as Resolved.

This work is completed and the notebook is on GitHub: https://github.com/nettrom/Growth-welcomesurvey-2018/blob/master/T275172_survey_aggregation.ipynb

Fri, Jul 23, 10:36 PM · Patch-For-Review, Growth-Team (Current Sprint), Product-Analytics (Kanban), Analytics-Radar, Growth-Scaling
nettrom_WMF closed T277355: Add a link: leading indicators as Resolved.

The analysis has been updated to categorize users depending on whether they registered before or after deployment of Add a Link, in order to make comparisons between Add a Link and the unstructured link task easier, as well as to make it clearer that existing users were getting Add a Link almost exclusively. This could otherwise have created a lot of confusion, as prolific experienced users would make Add a Link look overwhelmingly good.

Fri, Jul 23, 10:34 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint), Growth-Structured-Tasks
nettrom_WMF closed T277355: Add a link: leading indicators, a subtask of T273827: Add a link: instrumentation, as Resolved.
Fri, Jul 23, 10:34 PM · Growth-Team, Add-Link, Growth-Structured-Tasks

Wed, Jul 21

nettrom_WMF updated subscribers of T287121: Add geolocation information to Growth schemas.

From what I've been able to find, this is the first time this has been requested, and so I'm unsure what exactly to ask for and how to do this. I'm hoping someone from Data Engineering can help us out. I suspect @Ottomata is the right person to tag first, so adding him here.

Wed, Jul 21, 8:56 PM · Analytics-Radar, Growth-Team (Current Sprint), Product-Analytics
nettrom_WMF created T287121: Add geolocation information to Growth schemas.
Wed, Jul 21, 8:55 PM · Analytics-Radar, Growth-Team (Current Sprint), Product-Analytics
nettrom_WMF added a comment to T268708: Add a link: mobile navigation in suggested edits module.

This looks good to me! Having it as a separate event should work great (the other option I'd suggest would be to use action_data to make it possible to distinguish them, but I don't think that's necessary, let's go with the current plan!)

Wed, Jul 21, 5:17 PM · Patch-For-Review, Growth-Team (Current Sprint), Growth-Team-Filtering, GrowthExperiments, Add-Link, Growth-Structured-Tasks
nettrom_WMF added a comment to T278115: Instrumentation: Edit mode toggle.

Looks good to me! I +1'ed the schema patch, and if a +2 is needed at some point just let me know and I can do that too.

Wed, Jul 21, 4:59 PM · Patch-For-Review, Growth-Team (Current Sprint), Add-Link, Growth-Structured-Tasks
nettrom_WMF added projects to T286746: Access request to Superset for toberto: SRE, SRE-Access-Requests.

@nettrom_WMF Hi Morten! I've signed the doc and completed info up above. One question: is the approver my manager or someone else? Thanks!

Wed, Jul 21, 2:46 PM · SRE-Access-Requests, SRE, Product-Analytics, Structured-Data-Backlog
nettrom_WMF added a comment to T279105: Create/revive Search Platform team metrics dashboard.

@nettrom_WMF , thanks! I'm currently getting a Presto error that says access denied and that I should contact chart owners for assistance. Have tried reloading a few times but didn't seem to help. Any advice?

Wed, Jul 21, 2:36 PM · Discovery-Search, Product-Analytics (Kanban)

Tue, Jul 20

nettrom_WMF added a comment to T279105: Create/revive Search Platform team metrics dashboard.

@MPhamWMF : We now have a test dashboard for user satisfaction (item number 2), it's available here: https://superset.wikimedia.org/r/628

Tue, Jul 20, 7:56 PM · Discovery-Search, Product-Analytics (Kanban)

Mon, Jul 19

nettrom_WMF added a comment to T278115: Instrumentation: Edit mode toggle.

I love that we have active_interface, and I think editmode_confirmation_dialog makes great sense to use for this!

Mon, Jul 19, 9:39 PM · Patch-For-Review, Growth-Team (Current Sprint), Add-Link, Growth-Structured-Tasks
nettrom_WMF updated subscribers of T279105: Create/revive Search Platform team metrics dashboard.

I've added @cchen as the second assignee to this task. She'll be picking up this task as we transition my work from Search and Structured Data. So far that means she'll start working on item number 3.

Mon, Jul 19, 8:52 PM · Discovery-Search, Product-Analytics (Kanban)
nettrom_WMF updated Other Assignee for T279105: Create/revive Search Platform team metrics dashboard, added: cchen.
Mon, Jul 19, 8:49 PM · Discovery-Search, Product-Analytics (Kanban)
nettrom_WMF placed T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake up for grabs.
Mon, Jul 19, 4:44 PM · Analytics, Structured-Data-Backlog, Product-Analytics
nettrom_WMF closed T282028: Newcomer Tasks: finalize reporting notebook as Resolved.

Closing this task as resolved to not keep this around as an eternal phab task that Marshall and I can play Pong with by sending back and forth. We might want to make changes to the notebook to support Add a Link more specifically, or other things as the team deploys new features. If so, we'll discuss and create a new task for that and prioritize as needed.

Mon, Jul 19, 2:30 PM · Product-Analytics (Kanban), NewcomerTasks 1.2, Growth-Team (Current Sprint)
nettrom_WMF closed T282028: Newcomer Tasks: finalize reporting notebook, a subtask of T255517: Newcomer tasks: reporting notebook after schema changes, as Resolved.
Mon, Jul 19, 2:30 PM · Product-Analytics (Kanban), NewcomerTasks 1.2, Growth-Team (Current Sprint)

Fri, Jul 16

nettrom_WMF added a project to T286816: Add a link: analysis: Product-Analytics.
Fri, Jul 16, 8:18 PM · Growth-Team (Current Sprint), Product-Analytics, Add-Link, Growth-Structured-Tasks
nettrom_WMF added a comment to T286002: Donors to newcomers: baseline constructive activation.

The Growth features were deployed to the Spanish Wikipedia on 2021-04-21 (ref: T278235#7025299). I'd like to use MediaWiki history for this because it's generally accepted as the canonical dataset for user and editing data, and because that's what I've used for NEWTEA revisited so I have a data gathering pipeline that's easy to adapt. Based on the key results and other metrics in T286796, we don't really need editing data from August, so we can use the July snapshot of MediaWiki history (which will be available in early August).

Fri, Jul 16, 5:29 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF added a project to T286796: Donors to newcomers: analysis: Product-Analytics.
Fri, Jul 16, 5:16 PM · Product-Analytics, Growth-Team (Current Sprint)

Thu, Jul 15

nettrom_WMF added a comment to T286523: Donors to Newcomers: measure the success of test batch emails.

I guess it might not be possible if there was only one signup per wiki, but it would be nice to see a mobile / desktop split too, as the UI is quite different so it's theoretically possible we only broke one of them.

Thu, Jul 15, 9:39 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF created T286746: Access request to Superset for toberto.
Thu, Jul 15, 8:48 PM · SRE-Access-Requests, SRE, Product-Analytics, Structured-Data-Backlog
nettrom_WMF added a comment to T286523: Donors to Newcomers: measure the success of test batch emails.

This work has now been completed. The query that was run is below, which for simplicity doesn't exclude known test accounts. I also ran a query to manually inspect each account and removed one test account from the results. We then got the following table with number of signups:

Thu, Jul 15, 1:48 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)

Tue, Jul 13

nettrom_WMF triaged T286523: Donors to Newcomers: measure the success of test batch emails as High priority.
Tue, Jul 13, 5:13 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF triaged T286002: Donors to newcomers: baseline constructive activation as Medium priority.
Tue, Jul 13, 5:13 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF added a comment to T286493: Investigate running Stan models on GPU.

Case in point, I'm fitting one of these models for NEWTEA revisited (T270786) and as of yesterday it's running time is 338 hours. Here's a screenshot of htop, running time is the 11th column (TIME+). While some of this might be contributed to the model specification or the data, I wouldn't be surprised to see 24–48 hours to completion because that's what it took in previous analysis.

Tue, Jul 13, 2:35 PM · Analytics-Radar, Product-Analytics

Mon, Jul 12

nettrom_WMF set Due Date to Thu, Jul 15, 2:00 PM on T286523: Donors to Newcomers: measure the success of test batch emails.
Mon, Jul 12, 10:15 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF created T286523: Donors to Newcomers: measure the success of test batch emails.
Mon, Jul 12, 10:14 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF added a project to T286002: Donors to newcomers: baseline constructive activation: Product-Analytics.
Mon, Jul 12, 9:26 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)

Thu, Jul 1

nettrom_WMF closed T265768: Statistics on media usage across Wikipedias, a subtask of T261343: Dashboard of multimedia usage on the Wikipedias, as Resolved.
Thu, Jul 1, 10:09 PM · Epic, Structured-Data-Backlog, Product-Analytics
nettrom_WMF closed T265768: Statistics on media usage across Wikipedias as Resolved.

I've updated the task description with a link to the notebook so it's easier to do this if questions related to this get asked and prioritized in the future. For now, closing as resolved.

Thu, Jul 1, 10:09 PM · Product-Analytics (Kanban), Structured-Data-Backlog
nettrom_WMF updated the task description for T265768: Statistics on media usage across Wikipedias.
Thu, Jul 1, 10:07 PM · Product-Analytics (Kanban), Structured-Data-Backlog
nettrom_WMF added a comment to T272664: Add a link: refresh button on post-edit dialog (nice to have).

@mewoph – These events all look correct to me! I also reviewed the schema patch and +1'ed it. Let me know if a +2 is needed there, as I'd be happy to do that as well.

Thu, Jul 1, 2:32 PM · Patch-For-Review, Growth-Team (Current Sprint), Growth-Team-Filtering, GrowthExperiments, Add-Link, Growth-Structured-Tasks

Jun 30 2021

nettrom_WMF added a comment to T272664: Add a link: refresh button on post-edit dialog (nice to have).

For the impression event, should we send one when the new task is shown? If so, should we use the existing postedit-impression event or a new one? I was looking at the data sent for postedit-impression and it looks like only the information about the task that was just saved is sent so upon refresh (not the information about the next task).

Jun 30 2021, 8:50 PM · Patch-For-Review, Growth-Team (Current Sprint), Growth-Team-Filtering, GrowthExperiments, Add-Link, Growth-Structured-Tasks

Jun 29 2021

nettrom_WMF added a comment to T285728: User Links: Move username link.

Pinging @MMiller_WMF and @nettrom_WMF - should this be something we keep track of?

Jun 29 2021, 9:29 PM · MW-1.37-notes (1.37.0-wmf.15; 2021-07-19), RW-Feature-DI-User-Menu, Readers-Web-Backlog (Kanbanana-FY-2020-21), Desktop Improvements
nettrom_WMF added a comment to T272664: Add a link: refresh button on post-edit dialog (nice to have).

@nettrom_WMF -- I wanted to ping you again about how you think we should instrument the click on this button. Would you like there to be an explicit event? What should it contain?

Jun 29 2021, 8:48 PM · Patch-For-Review, Growth-Team (Current Sprint), Growth-Team-Filtering, GrowthExperiments, Add-Link, Growth-Structured-Tasks

Jun 28 2021

nettrom_WMF moved T277355: Add a link: leading indicators from Doing to Needs Sign-off on the Product-Analytics (Kanban) board.

The analysis has been done and shared with the team. I uploaded the notebook for the analysis to GitHub. Next steps are sharing these more widely, which I'm leaving in the capable hands of @MMiller_WMF, but I can help where needed. The Growth team had many follow up questions, and we need to create a new task with those questions so they can be prioritized and answered.

Jun 28 2021, 11:12 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint), Growth-Structured-Tasks
nettrom_WMF added a comment to T285169: Changing search term while on MediaSearch doesn't update "Switch to Special:Search" link target.

Here's a somewhat related question: should we add instrumentation to track when users click the "switch to special:search" link? Could be useful to know how many users are still reaching for the non-MediaSearch interface.

This would be useful, but I wonder if we can already gather than info just based on usage data for the Special:Search interface, without needing to specifically know whether users are switching over. What do you think @nettrom_WMF ?

Jun 28 2021, 9:33 PM · Structured-Data-Backlog (Current Work), SDAW-MediaSearch

Jun 23 2021

nettrom_WMF added a comment to T284481: Deploy Add a link to the second set of wikis.

@kostajh -- yes, I think we should deploy with the A/B test like we did in our pilot wikis, where half of the users get the structured task and the other half get the unstructured task. @nettrom_WMF, do you agree with that? Would having that additional data from these larger wikis help us see the differences that "add a link" makes?

Jun 23 2021, 9:29 PM · CommRel-Specialists-Support (Jul-Sep-2021), Growth-Team (Current Sprint), Add-Link

Jun 21 2021

nettrom_WMF closed T207528: To what extent do newly registered users search for how-to information?, a subtask of T205754: [EPIC] Growth: Understanding first day, as Declined.
Jun 21 2021, 4:54 PM · Growth-Team (Current Sprint), GrowthExperiments, Epic
nettrom_WMF closed T207528: To what extent do newly registered users search for how-to information? as Declined.

This is a task that would be interesting to do. At the same time, it's unclear when or if it'll be a priority for the Growth team. Should the need to understand more about how newcomers search for how-to information come up at some point in the future, I suggest creating a new task with a fresh set of questions based on the team's needs at that time.

Jun 21 2021, 4:54 PM · Growth-Team-Filtering, Product-Analytics, Growth-Team
nettrom_WMF closed T207526: New account interaction with Echo post registration, a subtask of T206802: Understanding first day: audit other schema logic, as Declined.
Jun 21 2021, 4:54 PM · Growth-Team (Current Sprint), Product-Analytics
nettrom_WMF closed T207526: New account interaction with Echo post registration as Declined.

This is a task that would be interesting to do. At the same time, it's unclear when or if it'll be a priority for the Growth team. Should the need to understand more about usage of Echo come up at some point in the future, I suggest creating a new task with a fresh set of questions based on the team's needs at that time.

Jun 21 2021, 4:53 PM · Growth-Team-Filtering, Product-Analytics, Growth-Team
nettrom_WMF closed T222928: Homepage: Start module prompts to create userpage in place of global userpage as Declined.

We've changed the start module to no longer have a CTA to create a user page, so I'm declining this.

Jun 21 2021, 4:52 PM · Growth-Team-Filtering, GrowthExperiments-Homepage, Growth-Team
nettrom_WMF closed T205654: Move page creation queries to Hive as Declined.

The dashboards that used this data are no longer in use, and there has been no feedback suggesting a need for the data. I see no need to keep this task around.

Jun 21 2021, 4:50 PM · Analytics-Radar, Product-Analytics
nettrom_WMF closed T192515: Measurement for AfC improvement (April 2018) as Declined.

As obvious from the earlier discussion in this task, completing this is complicated. It's unclear at this point that this is still within the scope of the Growth team's work. In summary: declining this.

Jun 21 2021, 4:45 PM · Growth-Team-Filtering, Analytics-Radar, Product-Analytics, Growth-Team
nettrom_WMF closed T192515: Measurement for AfC improvement (April 2018), a subtask of T193782: [EPIC] Prioritization tools for AfC and NPP, as Declined.
Jun 21 2021, 4:44 PM · Growth-Team (Current Sprint), English-Wikipedia-New-Pages-Patrol
nettrom_WMF created T285234: [M] MediaSearch: clicking the More Details link on mobile Safari pulls up browser toolbar.
Jun 21 2021, 2:41 PM · MW-1.37-notes (1.37.0-wmf.15; 2021-07-19), Patch-For-Review, Structured-Data-Backlog (Current Work)
nettrom_WMF closed T281748: [S] More details link in MediaSearch on mobile goes to desktop site as Declined.

Tested this in Firefox on my phone and it redirects just fine to the mobile site there, so it looks like this only happens if you pull up the mobile site on a non-mobile browser because then the redirect doesn't happen. Closing this as declined.

Jun 21 2021, 2:32 PM · Structured-Data-Backlog (Current Work), SDAW-MediaSearch

Jun 17 2021

nettrom_WMF added a comment to T284800: Donors to newcomers: URL parameters.

@MMiller_WMF : I set up a time for us to meet early next week to chat about this project so I don't miss anything important.

Jun 17 2021, 5:59 PM · MW-1.37-notes (1.37.0-wmf.12; 2021-06-28), Patch-For-Review, Growth-Team (Current Sprint)

Jun 14 2021

nettrom_WMF added a comment to T284705: Estimate the impact of the growth features on ptwiki.

@jwang : I fiddled with the active editors query a bit and created a notebook that combines it with the Growth dataset of registrations from October/November 2020 to count the number of them that edits every month from Nov 2020 through May 2021, split by whether they had the Growth features or not. You can find that notebook here. Let me know what questions you might have about this!

Jun 14 2021, 7:32 PM · Product-Analytics (Kanban)
nettrom_WMF closed T260254: Measure usage of Media Search integration in Visual Editor as Resolved.

Closing as resolved, thanks!

Jun 14 2021, 3:04 PM · Product-Analytics (Kanban), Structured-Data-Backlog, SDAW-MediaSearch (MediaSearch-ReleaseCandidate)
nettrom_WMF moved T277355: Add a link: leading indicators from Doing to Needs Sign-off on the Product-Analytics (Kanban) board.

I've drafted a slide deck and handed it off to Marshall for review. Once we've resolved any outstanding issues, I'll write up a summary and resolve this task.

Jun 14 2021, 2:54 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint), Growth-Structured-Tasks

Jun 9 2021

nettrom_WMF moved T277355: Add a link: leading indicators from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.
Jun 9 2021, 2:39 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint), Growth-Structured-Tasks
nettrom_WMF moved T277355: Add a link: leading indicators from Ready for Development to In Progress on the Growth-Team (Current Sprint) board.
Jun 9 2021, 2:38 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint), Growth-Structured-Tasks

Jun 8 2021

nettrom_WMF moved T265771: Measure how multimedia content is added to Wikipedia articles from Tracking to Current Quarter on the Product-Analytics board.

Moving this out of Product Analytics' "tracking" column as the edit tags have been deployed. We'd now like to get some example charts in Superset based on edits_hourly.

Jun 8 2021, 5:19 PM · Image-Suggestions, Structured-Data-Backlog, Product-Analytics
nettrom_WMF edited projects for T277355: Add a link: leading indicators, added: Product-Analytics (Kanban); removed Product-Analytics.
Jun 8 2021, 5:11 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint), Growth-Structured-Tasks

Jun 7 2021

nettrom_WMF added a comment to T284119: Growth: options for disabling/enabling Growth features for groups of users.

I think it makes sense to add geForceVariant=control to all the account creation links on both Wiki Education Dashboard and Programs & Events Dashboard, as this won't matter for languages that aren't currently doing testing and it will keep new users from en.wiki editathons and such out of the experiment group over the next few months as well.

@nettrom_WMF any concerns about that?

Jun 7 2021, 11:30 PM · User-Urbanecm_WMF (Engineering), Growth-Team (Current Sprint)
nettrom_WMF added a comment to T273827: Add a link: instrumentation.

@kostajh @Tgr : From what I know, the way we use EditAttemptStep means that we set the is_oversample field to true whenever we're logging a session that wouldn't normally be logged. Also as far as I know other people who work with that data know about this and will use that field to exclude oversampled sessions, but I'll mention it in our team meeting tomorrow just in case.

Jun 7 2021, 10:47 PM · Growth-Team, Add-Link, Growth-Structured-Tasks
nettrom_WMF added a project to T277355: Add a link: leading indicators: Product-Analytics.

Adding Product Analytics to the project tags so we can triage this in board refinement tomorrow.

Jun 7 2021, 5:04 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint), Growth-Structured-Tasks

Jun 2 2021

nettrom_WMF added a comment to T279105: Create/revive Search Platform team metrics dashboard.

@MPhamWMF : I've been working on putting together a notebook to aggregate user engagement metrics (full text query sessions with a dwell time of > 10 seconds), so we have a working example of using data from SearchSatisfaction. From digging into data from that schema, it appears to only be instrumented on desktop. Could you check in with the engineers on the team about whether that's the case? I want to make sure I'm not looking for non-existent data.

Jun 2 2021, 11:28 PM · Discovery-Search, Product-Analytics (Kanban)

Jun 1 2021

nettrom_WMF moved T282028: Newcomer Tasks: finalize reporting notebook from Doing to Needs Sign-off on the Product-Analytics (Kanban) board.

The notebook has been sent to Marshall for review, moving to "Needs Sign-off".

Jun 1 2021, 3:31 PM · Product-Analytics (Kanban), NewcomerTasks 1.2, Growth-Team (Current Sprint)

May 31 2021

nettrom_WMF claimed T216668: Welcome survey: investigate Vietnamese abandonment rate.
May 31 2021, 5:24 PM · Growth-Team-Filtering, Product-Analytics, Growth-Team, CommRel-Specialists-Support (Jan-Mar-2019)
nettrom_WMF placed T216668: Welcome survey: investigate Vietnamese abandonment rate up for grabs.
May 31 2021, 5:24 PM · Growth-Team-Filtering, Product-Analytics, Growth-Team, CommRel-Specialists-Support (Jan-Mar-2019)
nettrom_WMF claimed T217717: Emailability: basic measurement.
May 31 2021, 5:24 PM · Growth-Team-Filtering, Product-Analytics, Growth-Team
nettrom_WMF placed T217717: Emailability: basic measurement up for grabs.
May 31 2021, 5:24 PM · Growth-Team-Filtering, Product-Analytics, Growth-Team
nettrom_WMF claimed T217803: Homepage: experiment.
May 31 2021, 5:24 PM · Growth-Team-Filtering, Growth-Team, Product-Analytics, GrowthExperiments-Homepage
nettrom_WMF placed T217803: Homepage: experiment up for grabs.
May 31 2021, 5:23 PM · Growth-Team-Filtering, Growth-Team, Product-Analytics, GrowthExperiments-Homepage

May 27 2021

nettrom_WMF moved T260254: Measure usage of Media Search integration in Visual Editor from Doing to Needs Sign-off on the Product-Analytics (Kanban) board.

I've added window-open-from-command to our data gathering, taking into account that it represents multiple ways of working with media (both inserting new media and editing existing media). It's represented as the "other" path in the dashboard. The dashboard's description of the paths has also been updated. The usage of search in this path is low, and we end up seeing a lot of variance in the proportion of completed edits in this path as a result.

May 27 2021, 11:15 PM · Product-Analytics (Kanban), Structured-Data-Backlog, SDAW-MediaSearch (MediaSearch-ReleaseCandidate)

May 26 2021

nettrom_WMF added a comment to T283723: [REQUEST] Update QA process to account for expected differences in event counts for iOS/Android.

Thanks, @DAbad ! The Product Analytics team will prioritize this request in our next board refinement meeting (June 1).

May 26 2021, 2:16 PM · Product-Analytics

May 25 2021

dcausse awarded T279105: Create/revive Search Platform team metrics dashboard a Love token.
May 25 2021, 3:30 PM · Discovery-Search, Product-Analytics (Kanban)

May 24 2021

nettrom_WMF moved T260254: Measure usage of Media Search integration in Visual Editor from Needs Investigation to Doing on the Product-Analytics (Kanban) board.

The answer is that the user can open the media dialogue for example by double clicking on an image, or dragging and dropping an image into the editor. Both of those approaches result in a window-open-from-command event. I noticed that these events are more frequent on the phone platform, compared to the desktop. Either way, moving this back into "Doing". I'll then update the notebook to capture these and pull in some historic data.

May 24 2021, 11:14 PM · Product-Analytics (Kanban), Structured-Data-Backlog, SDAW-MediaSearch (MediaSearch-ReleaseCandidate)
nettrom_WMF closed T259308: Measure usage of image search in Visual Editor as Resolved.

I'm closing this as resolved as we're also tracking this work in T260254

May 24 2021, 5:48 PM · SDAW-MediaSearch (MediaSearch-ReleaseCandidate), Product-Analytics (Kanban), Structured-Data-Backlog
nettrom_WMF closed T259308: Measure usage of image search in Visual Editor, a subtask of T260254: Measure usage of Media Search integration in Visual Editor, as Resolved.
May 24 2021, 5:48 PM · Product-Analytics (Kanban), Structured-Data-Backlog, SDAW-MediaSearch (MediaSearch-ReleaseCandidate)
nettrom_WMF moved T260254: Measure usage of Media Search integration in Visual Editor from Needs Sign-off to Needs Investigation on the Product-Analytics (Kanban) board.

Moving this back to "Needs investigation" while I ask the web folks how window-open-from-command works.

May 24 2021, 5:47 PM · Product-Analytics (Kanban), Structured-Data-Backlog, SDAW-MediaSearch (MediaSearch-ReleaseCandidate)
nettrom_WMF closed T216672: EditorJourney and Welcome Survey: second report as Declined.

EditorJourney was shut off in T252391. While the Welcome Survey is now on lots of wikis and we can ask lots of interesting questions to the data in it, our time is limited. If insights into WS is desired, we might want to look into collaborating with a research institution, or elevating the priority of that kind of work (e.g. as an OKR).

May 24 2021, 4:57 PM · Growth-Team-Filtering, Growth-Team, Product-Analytics
nettrom_WMF closed T216672: EditorJourney and Welcome Survey: second report, a subtask of T205754: [EPIC] Growth: Understanding first day, as Declined.
May 24 2021, 4:57 PM · Growth-Team (Current Sprint), GrowthExperiments, Epic
nettrom_WMF closed T216672: EditorJourney and Welcome Survey: second report, a subtask of T206365: [EPIC] Growth: Welcome survey, as Declined.
May 24 2021, 4:57 PM · Growth-Team (Current Sprint), GrowthExperiments, Epic
nettrom_WMF closed T230069: Newcomer tasks: report on leading indicators as Resolved.

This has been done, I think. Or even though it might not have been, it's no longer relevant. Closing as resolved.

May 24 2021, 4:35 PM · Growth-Team-Filtering, Product-Analytics, NewcomerTasks 1.0 , Growth-Team, GrowthExperiments-Homepage
nettrom_WMF closed T230069: Newcomer tasks: report on leading indicators, a subtask of T230068: Newcomer tasks: instrumentation, as Resolved.
May 24 2021, 4:35 PM · Product-Analytics, Epic, Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage
nettrom_WMF closed T270747: Variant tests: C vs. D analysis followup: editing at registration as Declined.

Declining this as we're doing a similar analysis for NEWTEA Revisited in T270786.

May 24 2021, 4:18 PM · Growth-Team-Filtering, Growth-Team, Product-Analytics
nettrom_WMF closed T270747: Variant tests: C vs. D analysis followup: editing at registration, a subtask of T246533: Variant tests: "initiation part 2" test (C vs. D), as Declined.
May 24 2021, 4:18 PM · Growth-Team-Filtering, GrowthExperiments, Growth-Team
nettrom_WMF closed T270785: Variant tests: C vs. D analysis followup: connection with Welcome Survey responses, a subtask of T246533: Variant tests: "initiation part 2" test (C vs. D), as Declined.
May 24 2021, 4:18 PM · Growth-Team-Filtering, GrowthExperiments, Growth-Team
nettrom_WMF closed T270785: Variant tests: C vs. D analysis followup: connection with Welcome Survey responses as Declined.

Declining this as we're doing a similar analysis for NEWTEA Revisited in T270786.

May 24 2021, 4:18 PM · Growth-Team-Filtering, Growth-Team, Product-Analytics
nettrom_WMF moved T278368: Measure percentage of Commons users opting out of MediaSearch as the default search experience from Current Quarter to Backlog on the Product-Analytics board.
May 24 2021, 4:16 PM · Structured-Data-Backlog, SDAW-MediaSearch, Product-Analytics

May 14 2021

nettrom_WMF moved T282028: Newcomer Tasks: finalize reporting notebook from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.
May 14 2021, 11:31 PM · Product-Analytics (Kanban), NewcomerTasks 1.2, Growth-Team (Current Sprint)
nettrom_WMF edited projects for T282028: Newcomer Tasks: finalize reporting notebook, added: Product-Analytics (Kanban); removed Product-Analytics.

Moving this to In Progress on the Growth sprint board, and onto the Product Analytics team's kanban board and into Doing. Because I'm doing this.

May 14 2021, 11:31 PM · Product-Analytics (Kanban), NewcomerTasks 1.2, Growth-Team (Current Sprint)

May 7 2021

nettrom_WMF added a comment to T282262: [Newpyter] Can't install 'haven' package with conda R but can with system R.

Similarly as in T282260, I tested this out with R 3.6.1 too. The installation fails with the same error message that's reported.

May 7 2021, 7:03 PM · Analytics-Kanban, Analytics
nettrom_WMF added a comment to T282260: [Newpyter] Can't install 'nloptr' R package on stat100[467], but can on stat100[58].

I ssh'ed to stat1006 and created a new stacked conda environment and activated it. Running R (/usr/lib/anaconda-wmf/bin/R specifically, which is 3.6.1 as listed above) and then running install.packages('nloptr') successfully installs the package for me. The library file it grabs is https://cran.rstudio.com/src/contrib/nloptr_1.2.2.2.tar.gz

May 7 2021, 6:56 PM · Analytics-Kanban, Analytics

May 5 2021

nettrom_WMF moved T279105: Create/revive Search Platform team metrics dashboard from Needs Review to Doing on the Product-Analytics (Kanban) board.
May 5 2021, 9:17 PM · Discovery-Search, Product-Analytics (Kanban)
nettrom_WMF created T282028: Newcomer Tasks: finalize reporting notebook.
May 5 2021, 5:19 PM · Product-Analytics (Kanban), NewcomerTasks 1.2, Growth-Team (Current Sprint)
nettrom_WMF added a comment to T278177: Add a link: create new Schema.

The "Learn more" link appears if it is set in MediaWiki:NewcomerTasks.json. Some wikis will have this, others may not. For example, cswiki has a "learnmore" link defined for the references task type but not for the new link-recommendation one https://cs.wikipedia.org/wiki/MediaWiki:NewcomerTasks.json

May 5 2021, 5:09 PM · Patch-For-Review, Product-Analytics, Add-Link, Growth-Team (Current Sprint), Growth-Structured-Tasks

May 4 2021

nettrom_WMF added a comment to T278177: Add a link: create new Schema.
  1. Onboarding, user clicks the "Learn more" link. I'd expect that to be captured as a action="link_click" but what is action_data set to? And in what interfaces is that available? There's some documentation of how action_data is set but not for the onboarding steps.

So, action=link_click and active_interface is onboarding_step_1, and the additional action_data is whether the "Don't show again" box is checked or unchecked. Does that sound OK?

May 4 2021, 11:21 PM · Patch-For-Review, Product-Analytics, Add-Link, Growth-Team (Current Sprint), Growth-Structured-Tasks

May 3 2021

nettrom_WMF created T281748: [S] More details link in MediaSearch on mobile goes to desktop site.
May 3 2021, 7:05 PM · Structured-Data-Backlog (Current Work), SDAW-MediaSearch
nettrom_WMF moved T279105: Create/revive Search Platform team metrics dashboard from Needs Investigation to Needs Review on the Product-Analytics (Kanban) board.
May 3 2021, 6:38 PM · Discovery-Search, Product-Analytics (Kanban)

Apr 30 2021

nettrom_WMF moved T278177: Add a link: create new Schema from Triage to Tracking on the Product-Analytics board.
Apr 30 2021, 11:11 PM · Patch-For-Review, Product-Analytics, Add-Link, Growth-Team (Current Sprint), Growth-Structured-Tasks