Page MenuHomePhabricator

mpopov (Mikhail Popov)
Manager, Data Science

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Friday

  • Clear sailing ahead.

User Details

User Since
Jul 27 2015, 4:15 PM (322 w, 1 d)
Availability
Available
IRC Nick
bearloga
LDAP User
Bearloga
MediaWiki User
MPopov (WMF) [ Global Accounts ]

Using statistical analysis, Bayesian inference, machine learning, and software/data engineering to solve problems and inform decisions in Product Analytics

Recent Activity

Yesterday

mpopov updated the task description for T291957: Puppet configuration for Product Analytics ETL jobs.
Tue, Sep 28, 10:16 PM · Patch-For-Review, Product-Analytics (Kanban)
mpopov updated subscribers of T291957: Puppet configuration for Product Analytics ETL jobs.

@Ottomata I tried, but ran into problems :( Please see my notes posted by Maya: T288677#7340751

Tue, Sep 28, 10:14 PM · Patch-For-Review, Product-Analytics (Kanban)
mpopov added a comment to T291297: Do the messages left for unregistered or logged-out IP editors get read by those editors?.

@Whatamidoing-WMF: Quick question about "to decide whether we need to re-structure communication methods for IP editors" to help us better understand this request – who is "we"?

Tue, Sep 28, 8:33 PM · Analytics-Radar, Product-Analytics
mpopov added a comment to T291958: Prototype notebook for testing ETL.
$ sudo -u analytics-product hive -f hive/create_test_table.hql --database wmf_product
Tue, Sep 28, 4:44 PM · Patch-For-Review, Product-Analytics (Kanban)
mpopov updated the task description for T291957: Puppet configuration for Product Analytics ETL jobs.
Tue, Sep 28, 4:40 PM · Patch-For-Review, Product-Analytics (Kanban)
mpopov triaged T291957: Puppet configuration for Product Analytics ETL jobs as High priority.
Tue, Sep 28, 3:33 PM · Patch-For-Review, Product-Analytics (Kanban)
mpopov triaged T291958: Prototype notebook for testing ETL as High priority.
Tue, Sep 28, 3:33 PM · Patch-For-Review, Product-Analytics (Kanban)
mpopov created T291958: Prototype notebook for testing ETL.
Tue, Sep 28, 3:32 PM · Patch-For-Review, Product-Analytics (Kanban)
mpopov created T291957: Puppet configuration for Product Analytics ETL jobs.
Tue, Sep 28, 3:32 PM · Patch-For-Review, Product-Analytics (Kanban)
mpopov created T291956: Migrate Key Product Metrics notebooks to analytics/wmf-product/jobs.
Tue, Sep 28, 3:32 PM · Product-Analytics
mpopov added a comment to T290207: ReviewNB support in GitLab.

If that feature is released (GitLab native support of Jupyter notebook reviews) would you all be willing to see if it meets your needs? We can of course engage with upstream to provide feedback if needed..

Tue, Sep 28, 3:04 PM · GitLab (Integrations), Product-Analytics, Upstream

Fri, Sep 24

mpopov added a comment to T290074: Users should run explicit commands to materialize schema versions, rather than using magic git hooks.

@Ottomata I would be in favor of a single npm run build command and removing the git hook magic to make schema materialization process more explicit.

Fri, Sep 24, 9:03 PM · Patch-For-Review, Analytics, Event-Platform

Fri, Sep 17

mpopov added a comment to T291195: Add MariaDB replicas to Superset.

@elukey: Megan's most pressing use case is discussiontools_subcription table, which is in frwiki but not frwiki_p.

Fri, Sep 17, 8:24 PM · Editing-team (Tracking), Product-Analytics, Analytics

Tue, Sep 14

mpopov moved T227782: Decommission obsolete Discovery Dashboards from Current Quarter to Upcoming Quarter on the Product-Analytics board.
Tue, Sep 14, 5:14 PM · Product-Analytics, Discovery-Search

Fri, Sep 10

mpopov updated the task description for T290693: Internal nbviewer instance for sharing notebooks among 'wmf' and 'nda' members.
Fri, Sep 10, 3:27 PM · Analytics, Product-Analytics
mpopov added a comment to T290693: Internal nbviewer instance for sharing notebooks among 'wmf' and 'nda' members.

@Urbanecm Thank you!!! That works really well as an interim solution and I was able to upload & restrict https://people.wikimedia.org/~bearloga/nda/druid-pageviews.html

Fri, Sep 10, 3:06 PM · Analytics, Product-Analytics
JAllemandou awarded T290693: Internal nbviewer instance for sharing notebooks among 'wmf' and 'nda' members a Cookie token.
Fri, Sep 10, 9:59 AM · Analytics, Product-Analytics

Thu, Sep 9

mpopov updated the task description for T290693: Internal nbviewer instance for sharing notebooks among 'wmf' and 'nda' members.
Thu, Sep 9, 8:49 PM · Analytics, Product-Analytics
mpopov added a parent task for T290693: Internal nbviewer instance for sharing notebooks among 'wmf' and 'nda' members: T156934: Functionality to share & view notebooks.
Thu, Sep 9, 8:48 PM · Analytics, Product-Analytics
mpopov added a subtask for T156934: Functionality to share & view notebooks: T290693: Internal nbviewer instance for sharing notebooks among 'wmf' and 'nda' members.
Thu, Sep 9, 8:48 PM · Product-Analytics, Analytics-SWAP, Analytics
mpopov renamed T156934: Functionality to share & view notebooks from Functionality to share & view SWAP notebooks to Functionality to share & view notebooks.
Thu, Sep 9, 8:48 PM · Product-Analytics, Analytics-SWAP, Analytics
mpopov moved T156934: Functionality to share & view notebooks from Triage to Tracking on the Product-Analytics board.
Thu, Sep 9, 8:48 PM · Product-Analytics, Analytics-SWAP, Analytics
mpopov merged T156980: Ability to view other users' notebooks into T156934: Functionality to share & view notebooks.
Thu, Sep 9, 8:47 PM · Product-Analytics, Analytics-SWAP, Analytics
mpopov merged task T156980: Ability to view other users' notebooks into T156934: Functionality to share & view notebooks.
Thu, Sep 9, 8:46 PM · PAWS
mpopov triaged T290693: Internal nbviewer instance for sharing notebooks among 'wmf' and 'nda' members as Low priority.
Thu, Sep 9, 8:45 PM · Analytics, Product-Analytics
mpopov lowered the priority of T256050: Add dimensions to editors_daily dataset from High to Medium.

Lowering the priority on this.

Thu, Sep 9, 8:13 PM · Analytics-Kanban, Patch-For-Review, Product-Analytics, Analytics

Wed, Sep 8

mpopov closed T287505: [SPIKE] Compile list of legacy Discovery dashboards (WDQS, External Referrer) stakeholders as Resolved.

Did this in T227782#7279316

Wed, Sep 8, 3:50 PM · Product-Analytics (Kanban)

Tue, Sep 7

mpopov moved T290207: ReviewNB support in GitLab from Triage to Tracking on the Product-Analytics board.
Tue, Sep 7, 5:22 PM · GitLab (Integrations), Product-Analytics, Upstream
mpopov added a parent task for T287420: Load past data in wmf_product KPM tables: T287284: Update Superset metrics dashboards to use 'wmf_product' datasource.
Tue, Sep 7, 5:11 PM · Product-Analytics (Kanban)
mpopov added a subtask for T287284: Update Superset metrics dashboards to use 'wmf_product' datasource: T287420: Load past data in wmf_product KPM tables.
Tue, Sep 7, 5:11 PM · Product-Analytics
mpopov removed a subtask for T287420: Load past data in wmf_product KPM tables: T287284: Update Superset metrics dashboards to use 'wmf_product' datasource.
Tue, Sep 7, 5:11 PM · Product-Analytics (Kanban)
mpopov removed a parent task for T287284: Update Superset metrics dashboards to use 'wmf_product' datasource: T287420: Load past data in wmf_product KPM tables.
Tue, Sep 7, 5:11 PM · Product-Analytics
mpopov moved T272986: Establish an easy and secure process for sharing confidential data from Blocked to Next 2 weeks on the Product-Analytics (Kanban) board.
Tue, Sep 7, 5:09 PM · Product-Analytics (Kanban)
mpopov reassigned T268790: Feedback on sample content dataset and dashboards from cchen to kzimmerman.
Tue, Sep 7, 5:07 PM · Product-Analytics (Kanban)
mpopov moved T281511: Add content_translation_event data stream to the sanitization allowlist from Needs Review to Doing on the Product-Analytics (Kanban) board.
Tue, Sep 7, 5:06 PM · Analytics-Radar, Product-Analytics (Kanban), Language-analytics, CX-analytics

Thu, Sep 2

mpopov added a comment to T289799: [REQUEST] Investigate decrease in New Registered Users.

From https://meta.wikimedia.org/wiki/Research:Newly_registered_user#Data_sources:

Thu, Sep 2, 7:32 PM · Analytics-Radar, Product-Analytics (Kanban)

Aug 24 2021

mpopov awarded T196211: Deploy CollabPad to officewiki a Yellow Medal token.
Aug 24 2021, 6:06 PM · VisualEditor, Wikimedia-Site-requests

Aug 23 2021

mpopov awarded T289505: Storytelling with Data workshop with Maya a Stroopwafel token.
Aug 23 2021, 6:21 PM · Product-Analytics
mpopov updated the task description for T275694: Draft of full process for instrumentation using new client libraries.
Aug 23 2021, 4:54 PM · Metrics-Platform, Product-Analytics, Analytics-Radar, Event-Platform, Product-Data-Infrastructure
mpopov updated subscribers of T275694: Draft of full process for instrumentation using new client libraries.
Aug 23 2021, 4:51 PM · Metrics-Platform, Product-Analytics, Analytics-Radar, Event-Platform, Product-Data-Infrastructure
mpopov placed T275694: Draft of full process for instrumentation using new client libraries up for grabs.
Aug 23 2021, 4:51 PM · Metrics-Platform, Product-Analytics, Analytics-Radar, Event-Platform, Product-Data-Infrastructure
mpopov placed T251637: Analyze Computer Aided Tagging on Commons up for grabs.

We're taking this off our radar for now. If an analysis is needed to make a decision feel free to re-tag Product-Analytics when that need arises and we'll re-triage then.

Aug 23 2021, 4:50 PM · Structured-Data-Backlog
mpopov moved T286493: Investigate running Stan models on GPU from Current Quarter to Backlog on the Product-Analytics board.
Aug 23 2021, 4:44 PM · Analytics-Radar, Product-Analytics
mpopov updated subscribers of T285110: Review code of interleaved-python.

This will be needed for @cchen's future analysis of Discovery-Search's interleaved A/B tests, so this can wait until whenever they start doing those again.

Aug 23 2021, 4:39 PM · Product-Analytics

Aug 21 2021

mpopov closed T285244: Metrics Platform Schema testing & feedback: Mikhail, a subtask of T285053: [EPIC] Metrics Platform Schema: Product Analytics Testing, as Resolved.
Aug 21 2021, 2:03 AM · Product-Analytics, Epic, Metrics-Platform
mpopov closed T285244: Metrics Platform Schema testing & feedback: Mikhail as Resolved.

Responded

Aug 21 2021, 2:03 AM · Product-Analytics (Kanban), Metrics-Platform
mpopov moved T285244: Metrics Platform Schema testing & feedback: Mikhail from Work in Progress to Done on the Metrics-Platform board.
Aug 21 2021, 2:03 AM · Product-Analytics (Kanban), Metrics-Platform
mpopov moved T285244: Metrics Platform Schema testing & feedback: Mikhail from Doing to Needs Sign-off on the Product-Analytics (Kanban) board.
Aug 21 2021, 2:03 AM · Product-Analytics (Kanban), Metrics-Platform

Aug 19 2021

mpopov added a comment to T289268: [REQUEST] Impact of TikTok's Jumps feature on Wikipedia traffic.

The team will review and triage this in our next workboard refinement meeting (Mon, 8/23)

Aug 19 2021, 4:57 PM · Product-Analytics (Kanban)
mpopov renamed T289268: [REQUEST] Impact of TikTok's Jumps feature on Wikipedia traffic from [REQUEST] to [REQUEST] Impact of TikTok's Jumps feature on Wikipedia traffic.
Aug 19 2021, 4:55 PM · Product-Analytics (Kanban)

Aug 13 2021

mpopov added a comment to T227782: Decommission obsolete Discovery Dashboards.

Mike has requested for an alternative visualization to be made available so I'm thinking of uploading the WDQS counts to Commons under the Data namespace and opening it up to be visualized on-wiki with the Graph extension.

Aug 13 2021, 11:49 PM · Product-Analytics, Discovery-Search
mpopov added a comment to T227782: Decommission obsolete Discovery Dashboards.

stat1007.eqiad.wmnet:/srv/discovery cleaned up (see log at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log#2021-08-13)

Aug 13 2021, 4:48 PM · Product-Analytics, Discovery-Search

Aug 12 2021

mpopov moved T227782: Decommission obsolete Discovery Dashboards from Icebox to Current Quarter on the Product-Analytics board.

The data outage since April (T287381) provided a great opportunity to re-evaluate whether the final two dashboards (External Traffic and WDQS) should be decommissioned at last.

Aug 12 2021, 4:28 PM · Product-Analytics, Discovery-Search
mpopov closed T287381: External referrer & WDQS metrics stopped updating on 2021-04-25 as Declined.

After consulting with Isaac (Research) about external traffic one and Mike (Search Platform) about WDQS one, I'm making the call to finally decommission the dashboards (T227782). The data that has already been collected will remain available for historical/archival reasons, but no further work will be done to get new data. As such, I'm declining this task.

Aug 12 2021, 3:59 PM · Product-Analytics (Kanban)
mpopov moved T280175: Fix default ownership and permissions for Hive managed databases in /user/hive/warehouse from Triage to Tracking on the Product-Analytics board.
Aug 12 2021, 2:43 PM · Product-Analytics, Analytics-Kanban, Analytics
mpopov added a project to T280175: Fix default ownership and permissions for Hive managed databases in /user/hive/warehouse: Product-Analytics.
Aug 12 2021, 2:43 PM · Product-Analytics, Analytics-Kanban, Analytics

Aug 11 2021

mpopov updated the task description for T288677: Enable movement metric calculation as analytics-product user.
Aug 11 2021, 9:42 PM · Product-Analytics (Kanban)
mpopov closed T288657: Change /user/hive/warehouse/wmf_product.db ownership to iflorez as Resolved.

Thank you very much! We really appreciate how quickly this was resolved.

Aug 11 2021, 9:42 PM · Analytics-Kanban, Product-Analytics, Analytics
mpopov closed T288657: Change /user/hive/warehouse/wmf_product.db ownership to iflorez, a subtask of T288140: July 2021 Wikimedia movement metrics, as Resolved.
Aug 11 2021, 9:42 PM · Product-Analytics (Kanban)
mpopov created T288677: Enable movement metric calculation as analytics-product user.
Aug 11 2021, 9:41 PM · Product-Analytics (Kanban)
mpopov renamed T288657: Change /user/hive/warehouse/wmf_product.db ownership to iflorez from write permission for analytics-privatedata-users to Change /user/hive/warehouse/wmf_product.db ownership to iflorez.
Aug 11 2021, 9:17 PM · Analytics-Kanban, Product-Analytics, Analytics
mpopov updated subscribers of T288657: Change /user/hive/warehouse/wmf_product.db ownership to iflorez.

@Mayakp.wiki was working with @Ottomata on this to change ownership before he went on vacation and there was a slight misunderstanding/miscommunication about what the group permissions should be going forward. Unfortunately it's a set of repositories of Jupyter notebooks (e.g. https://github.com/wikimedia-research/Readers-movement-metrics) so re-architecture would be considerable.

Aug 11 2021, 9:16 PM · Analytics-Kanban, Product-Analytics, Analytics
mpopov moved T288657: Change /user/hive/warehouse/wmf_product.db ownership to iflorez from Triage to Tracking on the Product-Analytics board.
Aug 11 2021, 8:11 PM · Analytics-Kanban, Product-Analytics, Analytics
mpopov added a subtask for T288140: July 2021 Wikimedia movement metrics: T288657: Change /user/hive/warehouse/wmf_product.db ownership to iflorez.
Aug 11 2021, 8:11 PM · Product-Analytics (Kanban)
mpopov added a parent task for T288657: Change /user/hive/warehouse/wmf_product.db ownership to iflorez: T288140: July 2021 Wikimedia movement metrics.
Aug 11 2021, 8:11 PM · Analytics-Kanban, Product-Analytics, Analytics
mpopov triaged T288657: Change /user/hive/warehouse/wmf_product.db ownership to iflorez as High priority.
Aug 11 2021, 8:10 PM · Analytics-Kanban, Product-Analytics, Analytics
mpopov reassigned T285053: [EPIC] Metrics Platform Schema: Product Analytics Testing from mpopov to Mayakp.wiki.

Reassigning to Maya, the new point person for Metrics Platform who has taken the lead on this.

Aug 11 2021, 6:45 PM · Product-Analytics, Epic, Metrics-Platform
mpopov renamed T227782: Decommission obsolete Discovery Dashboards from Retire obsolete Discovery Dashboards to Decommission obsolete Discovery Dashboards.
Aug 11 2021, 6:44 PM · Product-Analytics, Discovery-Search
mpopov closed T176433: Investigate Morelike API calls without referer header (mobile web) as Declined.
Aug 11 2021, 6:43 PM · Product-Analytics, Discovery-Analysis, Readers-Web-Backlog (Tracking), Discovery
mpopov awarded T288631: GitLab patch release: 13.12.10: Resolves "Username ending with MIME type format is not allowed" errors a Stroopwafel token.
Aug 11 2021, 4:13 PM · Release-Engineering-Team (Radar), User-brennen, serviceops, GitLab

Aug 5 2021

mpopov updated the task description for T288284: Metrics Platform Schema testing & feedback: Irene.
Aug 5 2021, 6:52 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov updated the task description for T285240: Metrics Platform Schema testing & feedback: Connie.
Aug 5 2021, 6:52 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov updated the task description for T285241: Metrics Platform Schema testing & feedback: Jennifer.
Aug 5 2021, 6:52 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov updated the task description for T285243: Metrics Platform Schema testing & feedback: Megan.
Aug 5 2021, 6:52 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov updated the task description for T285245: Metrics Platform Schema testing & feedback: Morten.
Aug 5 2021, 6:52 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov updated the task description for T285246: Metrics Platform Schema testing & feedback: Neil.
Aug 5 2021, 6:52 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov updated the task description for T285247: Metrics Platform Schema testing & feedback: Shay.
Aug 5 2021, 6:52 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov updated the task description for T285242: Metrics Platform Schema testing & feedback: Maya.
Aug 5 2021, 6:52 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov updated the task description for T285244: Metrics Platform Schema testing & feedback: Mikhail.
Aug 5 2021, 6:52 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov triaged T288284: Metrics Platform Schema testing & feedback: Irene as High priority.
Aug 5 2021, 6:50 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov set Due Date to Aug 21 2021, 4:00 AM on T285244: Metrics Platform Schema testing & feedback: Mikhail.
Aug 5 2021, 6:49 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov moved T285244: Metrics Platform Schema testing & feedback: Mikhail from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.
Aug 5 2021, 6:48 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov set Due Date to Aug 21 2021, 4:00 AM on T285242: Metrics Platform Schema testing & feedback: Maya.
Aug 5 2021, 6:48 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov set Due Date to Aug 21 2021, 4:00 AM on T285247: Metrics Platform Schema testing & feedback: Shay.
Aug 5 2021, 6:48 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov set Due Date to Aug 21 2021, 4:00 AM on T285246: Metrics Platform Schema testing & feedback: Neil.
Aug 5 2021, 6:48 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov set Due Date to Aug 21 2021, 4:00 AM on T285245: Metrics Platform Schema testing & feedback: Morten.
Aug 5 2021, 6:48 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov set Due Date to Aug 21 2021, 4:00 AM on T285243: Metrics Platform Schema testing & feedback: Megan.
Aug 5 2021, 6:48 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov set Due Date to Aug 21 2021, 4:00 AM on T285241: Metrics Platform Schema testing & feedback: Jennifer.
Aug 5 2021, 6:47 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov set Due Date to Aug 21 2021, 4:00 AM on T285240: Metrics Platform Schema testing & feedback: Connie.
Aug 5 2021, 6:47 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov moved T285240: Metrics Platform Schema testing & feedback: Connie from Blocked to Next 2 weeks on the Product-Analytics (Kanban) board.
Aug 5 2021, 6:46 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov moved T285241: Metrics Platform Schema testing & feedback: Jennifer from Blocked to Next 2 weeks on the Product-Analytics (Kanban) board.
Aug 5 2021, 6:46 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov moved T285243: Metrics Platform Schema testing & feedback: Megan from Blocked to Next 2 weeks on the Product-Analytics (Kanban) board.
Aug 5 2021, 6:46 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov moved T285245: Metrics Platform Schema testing & feedback: Morten from Blocked to Next 2 weeks on the Product-Analytics (Kanban) board.
Aug 5 2021, 6:46 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov moved T285246: Metrics Platform Schema testing & feedback: Neil from Blocked to Next 2 weeks on the Product-Analytics (Kanban) board.
Aug 5 2021, 6:46 PM · Product-Analytics (Kanban), Metrics-Platform
mpopov moved T285247: Metrics Platform Schema testing & feedback: Shay from Blocked to Next 2 weeks on the Product-Analytics (Kanban) board.
Aug 5 2021, 6:46 PM · Product-Analytics (Kanban), Metrics-Platform

Aug 3 2021

mpopov added a member for Product-Analytics: jwang.
Aug 3 2021, 5:58 PM

Jul 27 2021

mpopov edited projects for T287505: [SPIKE] Compile list of legacy Discovery dashboards (WDQS, External Referrer) stakeholders, added: Product-Analytics (Kanban); removed Product-Analytics.
Jul 27 2021, 5:18 PM · Product-Analytics (Kanban)
mpopov triaged T287505: [SPIKE] Compile list of legacy Discovery dashboards (WDQS, External Referrer) stakeholders as Medium priority.
Jul 27 2021, 5:18 PM · Product-Analytics (Kanban)
mpopov updated the task description for T227782: Decommission obsolete Discovery Dashboards.
Jul 27 2021, 5:15 PM · Product-Analytics, Discovery-Search

Jul 26 2021

mpopov added a comment to T287418: Request to be added to WMF-NDA phabricator group for Iflorez.

Thank you @Aklapper!

Jul 26 2021, 10:24 PM · WMF-NDA-Requests