Page MenuHomePhabricator
Create Task
Maniphest T359691

Remove any unnecessary intermediate tables managed by the movement_metrics ETL job
Closed, ResolvedPublic
Actions

Description

If in T359690 we determine that any of these tables can be removed, we need to (1) remove any associated code from the movement_metrics ETL job and (2) drop the tables.

  • Remove update_global_markets_pageviews.hql and reading_02_global_markets.ipynb from the repo
  • Drop wmf_product.global_markets_pageviews

Details

SubjectRepoBranchLines +/-
movement_metrics: Retire global_markets_pageviewsanalytics/wmf-product/jobsmaster+4 -154
Customize query in gerrit

Related Objects
Search...

Event Timeline

nshahquinn-wmf triaged this task as Medium priority.Mar 9 2024, 1:00 AM
nshahquinn-wmf created this task.
nshahquinn-wmf added a subtask: T359690: Determine if any intermediate tables managed by the movement_metrics ETL job can be removed.
nshahquinn-wmf moved this task from Incoming to Backlog on the Movement-Insights board.
nshahquinn-wmf removed subscribers: mpopov, Iflorez.
nshahquinn-wmf updated the task description. (Show Details)Apr 9 2024, 7:56 PM
gerritbot added a comment.Apr 9 2024, 10:59 PM

Change #1018386 had a related patch set uploaded (by Neil Shah-Quinn (WMF); author: Neil Shah-Quinn (WMF)):

[analytics/wmf-product/jobs@master] movement_metrics: Retire global_markets_pageviews

https://gerrit.wikimedia.org/r/1018386

gerritbot added a project: Patch-For-Review.Apr 9 2024, 10:59 PM
gerritbot added a comment.Fri, Apr 12, 5:21 PM

Change #1018386 merged by Hghani:

[analytics/wmf-product/jobs@master] movement_metrics: Retire global_markets_pageviews

https://gerrit.wikimedia.org/r/1018386

nshahquinn-wmf mentioned this in rAWPJb6c24a67d921: movement_metrics: Retire global_markets_pageviews.Fri, Apr 12, 5:23 PM
nshahquinn-wmf updated the task description. (Show Details)Mon, Apr 15, 4:44 AM
nshahquinn-wmf closed subtask T359690: Determine if any intermediate tables managed by the movement_metrics ETL job can be removed as Resolved.Mon, Apr 15, 11:55 PM
nshahquinn-wmf updated the task description. (Show Details)Tue, Apr 16, 12:24 AM
nshahquinn-wmf closed this task as Resolved.Tue, Apr 16, 1:13 AM

I will remove wmf_product.pageviews_corrected as part of T362593.

Maintenance_bot removed a project: Patch-For-Review.Fri, Apr 26, 6:53 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL