Page MenuHomePhabricator

nettrom_WMF (Morten Warncke-Wang)
Data Analyst, Product Analytics

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Wednesday

  • Clear sailing ahead.

User Details

User Since
Aug 21 2018, 8:23 PM (78 w, 5 d)
Availability
Available
IRC Nick
Nettrom
LDAP User
Unknown
MediaWiki User
MWang (WMF) [ Global Accounts ]

Recent Activity

Wed, Feb 19

nettrom_WMF moved T235548: Welcome survey: store aggregates from Doing to Next 2 weeks on the Product-Analytics (Kanban) board.
Wed, Feb 19, 8:32 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF moved T243632: Newcomer tasks: variant group and event alignment issues from Next 2 weeks to Needs Review on the Product-Analytics (Kanban) board.
Wed, Feb 19, 8:32 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage
nettrom_WMF moved T243632: Newcomer tasks: variant group and event alignment issues from Ready for Development to Needs PM Review on the Growth-Team (Current Sprint) board.
Wed, Feb 19, 8:32 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage
nettrom_WMF added a comment to T243632: Newcomer tasks: variant group and event alignment issues.

I've looked into the patterns in the first case, that a user activates the Newcomer Tasks module but we don't have a action = "se-activate" event recorded in HomepageModule. To do that, I found all users (excluding known test accounts) who have two consecutive visits in HomepageVisit that showed the Newcomer Tasks module going from "inactive" to "active". Then I joined the first of those sessions with HomepageModule in order to learn if we had any client-side data at all about that visit (which is where they would activate the module). Split by wiki and desktop/mobile, here's whether we have data for those:

Wed, Feb 19, 8:24 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage
nettrom_WMF added a comment to T243632: Newcomer tasks: variant group and event alignment issues.

@MMiller_WMF : my TL;DR of this is at ~0.5% of users who visit the Homepage do not have their user preferences set correctly to reflect the state of their group assignment in Homepage experiments. I find that to be a concern for two reasons: 1) we've assumed that these assignments are reliable; and 2) it's unclear at this point how this will work when we move to larger wikis.

Wed, Feb 19, 5:08 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage
nettrom_WMF added a comment to T243632: Newcomer tasks: variant group and event alignment issues.

I dug into the data we have for the two users that Marshall sent over information about. For one of the users, I could identify when they activated the Newcomer Tasks module (by comparing consecutive entries in the HomepageVisit schema). For those two visits, we had no data at all logged in HomepageModule. I noticed that the user was on mobile at the time, but don't yet know if that's a pattern.

Wed, Feb 19, 12:02 AM · Product-Analytics (Kanban), Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage

Tue, Feb 18

nettrom_WMF moved T233065: Deploy Help Panel to Basque Wikipedia from Blocked / Stalled to Q3 (FY2019-20) on the Product-Analytics board.
Tue, Feb 18, 6:47 PM · Product-Analytics, GrowthExperiments, Growth-Team (Current Sprint)
nettrom_WMF edited projects for T233065: Deploy Help Panel to Basque Wikipedia, added: Product-Analytics; removed Product-Analytics (Kanban).
Tue, Feb 18, 6:47 PM · Product-Analytics, GrowthExperiments, Growth-Team (Current Sprint)
nettrom_WMF moved T233066: Deploy Newcomer Homepage to Basque Wikipedia from Triage to Q3 (FY2019-20) on the Product-Analytics board.
Tue, Feb 18, 6:47 PM · Product-Analytics, GrowthExperiments, Growth-Team (Current Sprint)
nettrom_WMF edited projects for T233066: Deploy Newcomer Homepage to Basque Wikipedia, added: Product-Analytics; removed Product-Analytics (Kanban).
Tue, Feb 18, 6:46 PM · Product-Analytics, GrowthExperiments, Growth-Team (Current Sprint)
nettrom_WMF triaged T244931: Hash edit session ID in EditAttemptStep and VisualEditorFeatureUse whitelisting as Medium priority.
Tue, Feb 18, 6:28 PM · Growth-Team, Analytics, Product-Analytics
nettrom_WMF triaged T245354: Newcomer tasks: review and solidify reporting code as Medium priority.
Tue, Feb 18, 6:25 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage
nettrom_WMF triaged T245369: Homepage: discovery measurement (Feb 2020) as Medium priority.
Tue, Feb 18, 6:25 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint), GrowthExperiments-HomepageDiscovery, GrowthExperiments-Homepage
nettrom_WMF closed T243557: Homepage: purge old data as Resolved.

This is now completed and Legal has been notified.

Tue, Feb 18, 3:13 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF closed T244312: Homepage: purge sanitized event data through 2019-11-04 as Resolved.

Verified in Hive that data is not available for any of the three schemas up through 2019-11-04 and this task can be closed. Thanks for your work on this @fdans !

Tue, Feb 18, 3:01 PM · Analytics-Kanban, Product-Analytics, Analytics, Growth-Team (Current Sprint)
nettrom_WMF closed T244312: Homepage: purge sanitized event data through 2019-11-04, a subtask of T243557: Homepage: purge old data, as Resolved.
Tue, Feb 18, 3:01 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)

Sun, Feb 16

nettrom_WMF moved T243571: Newcomer tasks: users without task impressions from Doing to Needs Review on the Product-Analytics (Kanban) board.
Sun, Feb 16, 7:07 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage
nettrom_WMF moved T243571: Newcomer tasks: users without task impressions from Ready for Development to Needs PM Review on the Growth-Team (Current Sprint) board.

The analysis can be found in this notebook. For simplicity, I used the most recent 90 days of data, with known test accounts removed. I used HomepageModule as the authoritative source of data, because if a user blocks EventLogging we of course won't have any data at all.

Sun, Feb 16, 7:07 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage

Tue, Feb 11

nettrom_WMF added a comment to T244931: Hash edit session ID in EditAttemptStep and VisualEditorFeatureUse whitelisting.

The two listed schemas are the ones I know about that uses the editing session ID. If there are others, please do add them!

Tue, Feb 11, 9:14 PM · Growth-Team, Analytics, Product-Analytics
nettrom_WMF created T244931: Hash edit session ID in EditAttemptStep and VisualEditorFeatureUse whitelisting.
Tue, Feb 11, 9:13 PM · Growth-Team, Analytics, Product-Analytics
nettrom_WMF claimed T242816: [REQUEST] SDC metrics : Metrics with December numbers.

@Abit and @Ramsey-WMF : could you let me know if you have any concerns about the work done in this analysis? If not, then I'll go ahead and get this ticket closed next time Product Analytics reviews their board.

Tue, Feb 11, 12:09 AM · Product-Analytics (Kanban)

Mon, Feb 10

nettrom_WMF moved T238320: Deploy Newcomer Homepage to Ukrainian, Hungarian, Armenian Wikipedias from Tracking to Q3 (FY2019-20) on the Product-Analytics board.
Mon, Feb 10, 11:33 PM · Growth-Team (Current Sprint), Product-Analytics, GrowthExperiments
nettrom_WMF moved T238319: Deploy Help Panel to Ukrainian, Hungarian, Armenian Wikipedias from Tracking to Q3 (FY2019-20) on the Product-Analytics board.
Mon, Feb 10, 11:33 PM · Growth-Team (Current Sprint), Product-Analytics, GrowthExperiments
nettrom_WMF added a comment to T244780: [REQUEST] updated analysis of Wiki Education participants as a share of new active editors.

Hi @Ragesoss, acknowledging that the Product Analytics team has received this ticket and will review and prioritize it during our next board review meeting, which is on 2019-02-17.

Mon, Feb 10, 11:31 PM · Product-Analytics (Kanban)
nettrom_WMF moved T243557: Homepage: purge old data from Incoming to In Progress on the Growth-Team (Current Sprint) board.
Mon, Feb 10, 11:19 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF moved T241871: Newcomer tasks: undercounting of edits using EventLogging from In Progress to Needs PM Review on the Growth-Team (Current Sprint) board.
Mon, Feb 10, 10:37 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage
nettrom_WMF added a comment to T241871: Newcomer tasks: undercounting of edits using EventLogging.

I've dug into this using data from launch of Newcomer Tasks up until Feb 5, 2020. I've excluded known test accounts from the data gathering.

Mon, Feb 10, 10:12 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage
nettrom_WMF moved T230068: Newcomer tasks: instrumentation from Review to Tracking on the Product-Analytics board.
Mon, Feb 10, 7:10 PM · Product-Analytics, Epic, Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage
nettrom_WMF edited projects for T230068: Newcomer tasks: instrumentation, added: Product-Analytics; removed Product-Analytics (Kanban).
Mon, Feb 10, 7:10 PM · Product-Analytics, Epic, Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage
nettrom_WMF moved T241871: Newcomer tasks: undercounting of edits using EventLogging from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.
Mon, Feb 10, 5:35 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage
nettrom_WMF moved T241871: Newcomer tasks: undercounting of edits using EventLogging from Backlog to Doing on the NewcomerTasks 1.0 board.
Mon, Feb 10, 5:35 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage
nettrom_WMF moved T241871: Newcomer tasks: undercounting of edits using EventLogging from Ready for Development to In Progress on the Growth-Team (Current Sprint) board.
Mon, Feb 10, 5:35 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage
nettrom_WMF added a project to T241871: Newcomer tasks: undercounting of edits using EventLogging: Product-Analytics (Kanban).
Mon, Feb 10, 5:35 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage

Thu, Feb 6

nettrom_WMF moved T244312: Homepage: purge sanitized event data through 2019-11-04 from Triage to Tracking on the Product-Analytics board.
Thu, Feb 6, 9:08 PM · Analytics-Kanban, Product-Analytics, Analytics, Growth-Team (Current Sprint)
nettrom_WMF edited projects for T244312: Homepage: purge sanitized event data through 2019-11-04, added: Product-Analytics; removed Product-Analytics (Kanban).
Thu, Feb 6, 9:08 PM · Analytics-Kanban, Product-Analytics, Analytics, Growth-Team (Current Sprint)
nettrom_WMF moved T230069: Newcomer tasks: report on leading indicators from Doing to Next 2 weeks on the Product-Analytics (Kanban) board.

Moving this to "Next up", as I believe the next step here is to publish the results on-wiki, but that's currently not a high priority.

Thu, Feb 6, 9:07 PM · Product-Analytics, NewcomerTasks 1.0 , Growth-Team, GrowthExperiments-Homepage
nettrom_WMF added a comment to T244312: Homepage: purge sanitized event data through 2019-11-04.

Do we need to delete all data in the tables or just some specific partitions?

Thu, Feb 6, 6:44 PM · Analytics-Kanban, Product-Analytics, Analytics, Growth-Team (Current Sprint)
nettrom_WMF moved T243557: Homepage: purge old data from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.
Thu, Feb 6, 12:52 AM · Product-Analytics (Kanban), Growth-Team (Current Sprint)

Wed, Feb 5

nettrom_WMF closed T243559: Homepage: delete data from tables in nettrom_growth, a subtask of T243557: Homepage: purge old data, as Resolved.
Wed, Feb 5, 12:20 AM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF closed T243559: Homepage: delete data from tables in nettrom_growth as Resolved.

These tables have now been deleted, ref the terminal session shown below. Closing this task as resolved.

Wed, Feb 5, 12:20 AM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF updated the task description for T243559: Homepage: delete data from tables in nettrom_growth.
Wed, Feb 5, 12:16 AM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF added a comment to T243557: Homepage: purge old data.

T244312 has been created for tracking Analytics Engineering's part of this, deleting the data from the relevant sanitized EventLogging tables.

Wed, Feb 5, 12:15 AM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF created T244312: Homepage: purge sanitized event data through 2019-11-04.
Wed, Feb 5, 12:13 AM · Analytics-Kanban, Product-Analytics, Analytics, Growth-Team (Current Sprint)

Tue, Feb 4

nettrom_WMF closed T243558: Homepage: produce final status report prior to purging data, a subtask of T243557: Homepage: purge old data, as Resolved.
Tue, Feb 4, 11:59 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF closed T243558: Homepage: produce final status report prior to purging data as Resolved.

@MMiller_WMF has now run the final report using all available Homepage data, which means that we're ready to start deleting old data. Closing this task.

Tue, Feb 4, 11:59 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)

Mon, Feb 3

nettrom_WMF added a comment to T231952: [REQUEST] SDC metrics.

@Abit and @Ramsey-WMF : I've completed a first pass of an update to the search analysis, and am concerned about some of the underlying data. Since the last update of this analysis a year ago, EventLogging data is only available in Hive, so I updated the queries to work there. However, for some of the analysis, e.g. the the graph of daily search activity, shows a lack of data starting on 2019-12-10. I'm not sure if there were any changes to the EventLogging code for search at that point? If you or someone on your team knows, that would help me understand what's going on here and whether to dig further into the data.

Mon, Feb 3, 10:55 PM · Product-Analytics (Kanban)
nettrom_WMF triaged T243559: Homepage: delete data from tables in nettrom_growth as High priority.
Mon, Feb 3, 5:43 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF triaged T243558: Homepage: produce final status report prior to purging data as High priority.
Mon, Feb 3, 5:43 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF triaged T243557: Homepage: purge old data as High priority.
Mon, Feb 3, 5:42 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)

Jan 24 2020

nettrom_WMF updated subscribers of T242816: [REQUEST] SDC metrics : Metrics with December numbers.
Jan 24 2020, 5:54 PM · Product-Analytics (Kanban)
nettrom_WMF added a comment to T242816: [REQUEST] SDC metrics : Metrics with December numbers.

@Mayakp.wiki : pull request has been reviewed, conflicts resolved, and it's now merged. Thanks for your work on this!

Jan 24 2020, 5:29 PM · Product-Analytics (Kanban)

Jan 23 2020

nettrom_WMF added a comment to T243557: Homepage: purge old data.

I'll add the subtask for Analytics Engineering to delete data once the notebook is ready to run.

Jan 23 2020, 10:31 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF removed a subtask for T243558: Homepage: produce final status report prior to purging data: T243559: Homepage: delete data from tables in nettrom_growth.
Jan 23 2020, 10:30 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF added a subtask for T243557: Homepage: purge old data: T243559: Homepage: delete data from tables in nettrom_growth.
Jan 23 2020, 10:30 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF edited parent tasks for T243559: Homepage: delete data from tables in nettrom_growth, added: T243557: Homepage: purge old data; removed: T243558: Homepage: produce final status report prior to purging data.
Jan 23 2020, 10:30 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF created T243559: Homepage: delete data from tables in nettrom_growth.
Jan 23 2020, 10:29 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF created T243558: Homepage: produce final status report prior to purging data.
Jan 23 2020, 10:25 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF updated the task description for T243557: Homepage: purge old data.
Jan 23 2020, 10:23 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF created T243557: Homepage: purge old data.
Jan 23 2020, 10:22 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF created T243552: Superset aggregation across edit tags uses all tags.
Jan 23 2020, 9:34 PM · Analytics-Kanban, Product-Analytics, Analytics
nettrom_WMF added a comment to T231952: [REQUEST] SDC metrics.

@nettrom_WMF Yep, end of January is the target. We could extend the deadline a week, but then would need to set aside time for concerted synchronous work the second week of January, maybe a day, where we could get quick feedback on our interpretations and articulation of the results.

Jan 23 2020, 8:52 PM · Product-Analytics (Kanban)
nettrom_WMF added a comment to T231952: [REQUEST] SDC metrics.

@Abit & @Ramsey-WMF : I'm getting back into the swing of things, and am wondering about the priority and deadline for the two search related measurements above. Are they still needed, and if so, is the end of January also the deadline for those?

Jan 23 2020, 6:02 PM · Product-Analytics (Kanban)

Jan 7 2020

nettrom_WMF awarded T224658: Newpyter - First Class Jupyter Notebook system a Love token.
Jan 7 2020, 6:28 PM · Patch-For-Review, Analytics

Dec 24 2019

nettrom_WMF updated subscribers of T240890: Make wmfdata work with Kerberos.

I'll be following up on this after the holidays. While switching to the Spark backend does appear to work, it also has its own quirks. Some of the queries used in Homepage reports are slow, and querying mediawiki_history was also problematic. Here, "slow" means not finishing in several hours, which is a significant performance decrease compared to what we had with Hive. There might be configuration parameters that can alleviate this and I've had success with some, but want to discuss them with Analytics folks to understand tradeoffs in a shared environment. Now that we also have @mpopov's Hive CLI solution, we should consider the benefits and drawbacks of all these and what to do moving forward.

Dec 24 2019, 1:04 AM · Product-Analytics (Kanban)

Dec 23 2019

nettrom_WMF closed T240481: Add start_startediting_state to the whitelisting of the HomepageVisit schema, a subtask of T230068: Newcomer tasks: instrumentation, as Resolved.
Dec 23 2019, 6:44 PM · Product-Analytics, Epic, Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage
nettrom_WMF closed T240481: Add start_startediting_state to the whitelisting of the HomepageVisit schema as Resolved.

I checked event_sanitized.homepagevisit, and the whitelisting started on 2019-12-19. Closing this as done, thanks!

Dec 23 2019, 6:44 PM · Analytics, Product-Analytics (Kanban), Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage

Dec 22 2019

nettrom_WMF added a comment to T231952: [REQUEST] SDC metrics.

@Abit and @Ramsey-WMF : I've today updated the notebook used for the analysis of Question 2, as the analysis I did with @Mayakp.wiki on Question 1 identified a couple additional types of edit comments that should be included. This mainly affects the number of SDC edits for the last two quarters of this year, and shifts the proportions quite drastically upwards (above 10%) for those quarters.

Dec 22 2019, 10:45 PM · Product-Analytics (Kanban)
nettrom_WMF moved T240890: Make wmfdata work with Kerberos from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.
Dec 22 2019, 10:13 PM · Product-Analytics (Kanban)
nettrom_WMF added a comment to T240890: Make wmfdata work with Kerberos.

I ran some tests on notebook1004 and notebook1003. From what I can tell, the behavior of the library is the same in both cases. I did run into a couple of issues during installation/use that were no related to queries or data formats. I'll document those below.

Dec 22 2019, 10:13 PM · Product-Analytics (Kanban)

Dec 19 2019

nettrom_WMF updated subscribers of T240890: Make wmfdata work with Kerberos.

From our discussions, the best option moving forward appears to be to switch the backend from Hive to Spark. With thanks to @Ottomata, there's now a pull request that does this. Before merging it, we'll need some testing. From @Neil_P._Quinn_WMF, the following things need to be tested:

Dec 19 2019, 8:42 PM · Product-Analytics (Kanban)

Dec 16 2019

nettrom_WMF added a comment to T231952: [REQUEST] SDC metrics.

@Abit and @Ramsey-WMF : we discussed in our last meeting that the Information and Artwork template had been updated to pull SDC data in through Lua, and that you were interested in understanding the impact of that. Given the limited scope of this, I decided to go ahead and dig around in the data to see if I could figure it out. The work has been documented in this notebook on GitHub.

Dec 16 2019, 12:17 AM · Product-Analytics (Kanban)

Dec 13 2019

nettrom_WMF added a comment to T238484: Structured Data on Commons entities returned by mw.wikibase.getEntity lua function differ based on language of the viewer.

Based on our conversation in T231952, a couple of files on Commons that I suspect have been affected by this bug are:

Dec 13 2019, 1:00 AM · Structured-Data-Backlog (Current Work), Wikibase-Lua, MediaWiki-extensions-WikibaseClient, SDC General, Wikidata

Dec 11 2019

nettrom_WMF claimed T240481: Add start_startediting_state to the whitelisting of the HomepageVisit schema.
Dec 11 2019, 5:47 PM · Analytics, Product-Analytics (Kanban), Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage
nettrom_WMF created T240481: Add start_startediting_state to the whitelisting of the HomepageVisit schema.
Dec 11 2019, 5:46 PM · Analytics, Product-Analytics (Kanban), Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage
nettrom_WMF moved T237124: Growth: implement wider data purge window from Upcoming Work to External on the Growth-Team board.
Dec 11 2019, 5:44 PM · Growth-Team, Patch-For-Review, Analytics, Product-Analytics
nettrom_WMF edited projects for T237124: Growth: implement wider data purge window, added: Growth-Team; removed Growth-Team (Current Sprint).
Dec 11 2019, 5:44 PM · Growth-Team, Patch-For-Review, Analytics, Product-Analytics
nettrom_WMF moved T230069: Newcomer tasks: report on leading indicators from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.
Dec 11 2019, 5:41 PM · Product-Analytics, NewcomerTasks 1.0 , Growth-Team, GrowthExperiments-Homepage
nettrom_WMF claimed T230069: Newcomer tasks: report on leading indicators.
Dec 11 2019, 5:41 PM · Product-Analytics, NewcomerTasks 1.0 , Growth-Team, GrowthExperiments-Homepage

Dec 10 2019

nettrom_WMF added a comment to T231952: [REQUEST] SDC metrics.

So: wbc_entity_usage does not hold information about all entities. There are (many) entities that do not appear in wbc_entity_usage.
wbc_entity_usage (much like like categorylinks or templatelinks) track usage of entities via Lua.

Dec 10 2019, 12:29 AM · Product-Analytics (Kanban)
nettrom_WMF added a comment to T231952: [REQUEST] SDC metrics.

@Abit and @Ramsey-WMF : thanks for your patience with me getting this ready, turned out that I jumped the gun during our meeting and gave you numbers based on all edits, not just the ones made some number of days after upload. Anyways, we've got numbers, and while they might not be as impressive I think they're still positive!

Dec 10 2019, 12:24 AM · Product-Analytics (Kanban)

Dec 9 2019

nettrom_WMF moved T237124: Growth: implement wider data purge window from Needs Investigation to Tracking on the Product-Analytics board.
Dec 9 2019, 5:59 PM · Growth-Team, Patch-For-Review, Analytics, Product-Analytics
nettrom_WMF closed T237129: Password Reset metrics: How many registered users have an email account associated with their accounts and how many do not (in the top 10 wikis)?, a subtask of T229970: [REQUEST] Metrics Related to Password Reset Requests, as Resolved.
Dec 9 2019, 5:52 PM · Community-Tech, Product-Analytics
nettrom_WMF closed T237129: Password Reset metrics: How many registered users have an email account associated with their accounts and how many do not (in the top 10 wikis)? as Resolved.

You're most welcome, @ifried and @Prtksxna! Closing this as resolved, but please reopen it if needed.

Dec 9 2019, 5:52 PM · Chinese-Sites, Product-Analytics (Kanban), Community-Tech

Dec 4 2019

nettrom_WMF moved T235548: Welcome survey: store aggregates from Ready for Development to In Progress on the Growth-Team (Current Sprint) board.
Dec 4 2019, 8:17 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)
nettrom_WMF moved T216672: EditorJourney and Welcome Survey: second report from Q2 2019-20 to FY 2019-20 on the Growth-Team board.
Dec 4 2019, 8:16 PM · Growth-Team, Product-Analytics
nettrom_WMF edited projects for T216672: EditorJourney and Welcome Survey: second report, added: Growth-Team; removed Growth-Team (Current Sprint).
Dec 4 2019, 8:16 PM · Growth-Team, Product-Analytics
nettrom_WMF added a comment to T237124: Growth: implement wider data purge window.

@Nuria : HelpPanel, HomepageVisit, and HomepageModule. All three of those are whitelisted.

Dec 4 2019, 6:00 PM · Growth-Team, Patch-For-Review, Analytics, Product-Analytics
nettrom_WMF added a comment to T237124: Growth: implement wider data purge window.

@Nuria : I can confirm what @mforns mentions. During my conversations with him yesterday, it became clear to me that how the Growth team is using EventLogging is an in-between case. Since we're running fairly long experiments, we need data for longer than the default 90 days, but we also need richer data than what we'd limit ourselves to if we were to store data indefinitely. Hence a 270 day sliding window for our sanitized data would work well for us. (This is also why we asked for deletion of sanitized data in T234870 as we completed the Help Panel experiment, by the way, we no longer could keep that data around).

Dec 4 2019, 5:54 PM · Growth-Team, Patch-For-Review, Analytics, Product-Analytics

Dec 3 2019

nettrom_WMF added a comment to T231952: [REQUEST] SDC metrics.

I've now completed a preliminary analysis of question 3, quarterly measurement media containing structured fields using non-English languages. As discussed in our meeting last week, this translates to "files with captions in a non-English language". The code behind the analysis can be found in this notebook on GitHub.

Dec 3 2019, 8:07 PM · Product-Analytics (Kanban)

Dec 2 2019

nettrom_WMF moved T237129: Password Reset metrics: How many registered users have an email account associated with their accounts and how many do not (in the top 10 wikis)? from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.
Dec 2 2019, 5:36 PM · Chinese-Sites, Product-Analytics (Kanban), Community-Tech
nettrom_WMF moved T235548: Welcome survey: store aggregates from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.
Dec 2 2019, 5:36 PM · Product-Analytics (Kanban), Growth-Team (Current Sprint)

Nov 27 2019

nettrom_WMF added a comment to T230068: Newcomer tasks: instrumentation.

I think this is partly a design issue, which @RHo should chime in on, and partly a measurement issue. With regards to the design part, I'm trying to think ahead to how things might work with guidance. If the user is recommended the Egg tart article, clicks through to it, goes somewhere else, and then later returns to it, should they again see the guidance (meaning we treat them as if they came through from the Homepage)? I think the answer to that affects how we connect the Homepage schema to the Help Panel and EditAttemptStep schemas in that situation.

Nov 27 2019, 12:47 AM · Product-Analytics, Epic, Growth-Team (Current Sprint), NewcomerTasks 1.0 , GrowthExperiments-Homepage

Nov 26 2019

nettrom_WMF added a comment to T237129: Password Reset metrics: How many registered users have an email account associated with their accounts and how many do not (in the top 10 wikis)?.

Using the top 10 wikis based on the Wiki segmentation's size ranking (geometric mean of monthly active editors and monthly unique devices), I grabbed the number of accounts for each of them, the number of accounts with an email address set, and the number who have verified their email address. While verification numbers weren't requested, I already had that in the query I reused for this, and maybe the differences between wikis would be meaningful to the Community Tech team.

Nov 26 2019, 8:45 PM · Chinese-Sites, Product-Analytics (Kanban), Community-Tech

Nov 25 2019

nettrom_WMF added a comment to T237605: Create kerberos principals for users.

Like so many others, I'd like to request my credentials for access on stat100x and notebook100x. My username is nettrom. I'll keep an eye out on my Gmail spam folder as well, cheers! :)

Nov 25 2019, 8:05 PM · Patch-For-Review, Analytics-Kanban, Analytics

Nov 18 2019

nettrom_WMF added a project to T233066: Deploy Newcomer Homepage to Basque Wikipedia: Product-Analytics.
Nov 18 2019, 7:57 PM · Product-Analytics, GrowthExperiments, Growth-Team (Current Sprint)

Nov 7 2019

nettrom_WMF renamed T237675: Improve reporting guidelines to achieve non-draft status from Polish reporting guidelines to Improve reporting guidelines to achieve non-draft status.
Nov 7 2019, 7:37 PM · Product-Analytics

Nov 1 2019

nettrom_WMF added a comment to T235577: Homepage: ensure data retention is in line with the guideline exception.

What happens here is most likely related to T237124.

Nov 1 2019, 6:35 PM · Growth-Team, Analytics, GrowthExperiments, Product-Analytics
nettrom_WMF added a project to T237124: Growth: implement wider data purge window: Analytics.
Nov 1 2019, 6:33 PM · Growth-Team, Patch-For-Review, Analytics, Product-Analytics
nettrom_WMF added a project to T237124: Growth: implement wider data purge window: Product-Analytics.
Nov 1 2019, 6:28 PM · Growth-Team, Patch-For-Review, Analytics, Product-Analytics
nettrom_WMF moved T233363: New verification emails unexpectedly enabled on cswiki, kowiki, arwiki, viwiki from Review to Tracking on the Product-Analytics board.
Nov 1 2019, 6:16 PM · Product-Analytics, Growth-Team, GrowthExperiments