Page MenuHomePhabricator
Create Task
Maniphest T300025

Low Risk Oozie Migration: interlanguage
Closed, ResolvedPublic
Actions

Description

Goal:
Migrate the interlanguage jobs to Airflow:

Job Details:

InputProcessingOutput
Hive TableHiveHive Table

Success Criteria:

  • Have the 1 daily Jobs Migrated (SLA 48 Hours)

Related Objects
Search...

Event Timeline

• EChetty created this task.Jan 25 2022, 11:53 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 25 2022, 11:53 AM
• EChetty added a parent task: T299074: Migrate Oozie jobs to Airflow.Jan 25 2022, 12:01 PM
• odimitrijevic moved this task from Incoming (new tickets) to Transform on the Data-Engineering board.Feb 1 2022, 11:12 PM
• EChetty moved this task from Backlog to Discussed (Radar) on the Data Pipelines board.Feb 8 2022, 11:43 AM
• NOkafor-WMF claimed this task.Mar 17 2022, 3:53 PM
• NOkafor-WMF moved this task from Discussed (Radar) to Estimated on the Data Pipelines board.
mforns added a project: Data-Engineering-Kanban.Mar 30 2022, 4:14 PM
mforns moved this task from Next Up to In Progress on the Data-Engineering-Kanban board.
mforns moved this task from In Progress to In Code Review on the Data-Engineering-Kanban board.Mar 31 2022, 4:19 PM
• NOkafor-WMF moved this task from Estimated to In Review on the Data Pipelines board.Mar 31 2022, 4:32 PM
gerritbot added a comment.Apr 12 2022, 5:30 PM

Change 779523 had a related patch set uploaded (by NOkafor; author: NOkafor):

[analytics/refinery@master] updated usage from hive to spark2-sql Bug T300025, T302875

https://gerrit.wikimedia.org/r/779523

gerritbot added a project: Patch-For-Review.Apr 12 2022, 5:30 PM
gerritbot added a comment.Apr 12 2022, 10:42 PM

Change 779565 had a related patch set uploaded (by NOkafor; author: NOkafor):

[analytics/refinery@master] update usage from hive to spark2-sql Bug: T300025, T302875

https://gerrit.wikimedia.org/r/779565

Milimetric moved this task from In Code Review to Ready to Deploy on the Data-Engineering-Kanban board.Apr 14 2022, 4:07 PM
gerritbot added a comment.Apr 19 2022, 3:21 PM

Change 779565 abandoned by NOkafor:

[analytics/refinery@master] update usage from hive to spark2-sql Bug: T300025, T302875

Reason:

using a different patchset

https://gerrit.wikimedia.org/r/779565

gerritbot added a comment.Apr 19 2022, 3:22 PM

Change 779523 abandoned by NOkafor:

[analytics/refinery@master] updated usage from hive to spark2-sql Bug T300025, T302875

Reason:

using a different patchset

https://gerrit.wikimedia.org/r/779523

Maintenance_bot removed a project: Patch-For-Review.Apr 19 2022, 3:31 PM
Antoine_Quhen moved this task from Ready to Deploy to Done on the Data-Engineering-Kanban board.Apr 28 2022, 4:13 PM
• EChetty moved this task from In Review to Done on the Data Pipelines board.May 3 2022, 2:50 PM
gerritbot added a comment.May 19 2022, 4:15 PM

Change 793507 had a related patch set uploaded (by NOkafor; author: NOkafor):

[analytics/refinery@master] Performed the following changes;

https://gerrit.wikimedia.org/r/793507

gerritbot added a project: Patch-For-Review.May 19 2022, 4:15 PM
JArguello-WMF closed this task as Resolved.May 31 2022, 3:26 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits