Page MenuHomePhabricator
Create Task
Maniphest T329646

[Migration] Oozie Migration jobs for Pageviews dumps
Closed, ResolvedPublic9 Estimated Story Points
Actions

Description

Splitting this out from the parent task because it's more involved than we first thought.

  • oozie/pageview/daily_dumps
  • oozie/pageview/monthly_dumps

Details

ProjectBranchLines +/-Subject
analytics/refinerymaster+178 -0Migrate pageview dumps jobs
Customize query in gerrit

Related Objects
Search...

Event Timeline

Milimetric created this task.Feb 14 2023, 5:10 PM
Restricted Application removed a project: Patch-For-Review. · View Herald TranscriptFeb 14 2023, 5:10 PM
Milimetric moved this task from Ready to In Progress on the Data Pipelines (Sprint 08) board.Feb 14 2023, 5:10 PM
gerritbot added a comment.Feb 15 2023, 3:00 PM

Change 889532 had a related patch set uploaded (by Milimetric; author: Milimetric):

[analytics/refinery@master] Migrate pageview dumps jobs

https://gerrit.wikimedia.org/r/889532

gerritbot added a project: Patch-For-Review.Feb 15 2023, 3:00 PM
Milimetric moved this task from In Progress to In Review on the Data Pipelines (Sprint 08) board.Feb 15 2023, 5:00 PM
JArguello-WMF edited projects, added Data Pipelines (Sprint 11); removed Data Pipelines (Sprint 08).Feb 20 2023, 5:24 PM
JArguello-WMF moved this task from Next Up to In Review on the Data Pipelines (Sprint 11) board.Feb 20 2023, 5:25 PM
JArguello-WMF set the point value for this task to 9.Feb 21 2023, 5:08 PM
gerritbot added a comment.Mar 10 2023, 7:24 PM

Change 889532 merged by Milimetric:

[analytics/refinery@master] Migrate pageview dumps jobs

https://gerrit.wikimedia.org/r/889532

Milimetric moved this task from In Review to Ready to Deploy on the Data Pipelines (Sprint 11) board.Mar 10 2023, 8:50 PM

found a blocker: Druid pageview jobs need pageview_hourly to continue to create _SUCCESS files, but they weren't spelled out in the migration doc so this was missed. I'll update the airflow jobs on monday and resume deployment.

JArguello-WMF edited projects, added Data Pipelines (sprint 10); removed Data Pipelines (Sprint 11).Mar 13 2023, 1:56 PM
JArguello-WMF moved this task from Ready to Ready to Deploy on the Data Pipelines (sprint 10) board.
JArguello-WMF moved this task from Ready to Deploy to Done on the Data Pipelines (sprint 10) board.Mar 13 2023, 4:04 PM
JArguello-WMF closed this task as Resolved.Mar 20 2023, 6:11 PM
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL