Page MenuHomePhabricator

Make oozie work with spark jobs that use HiveContext
Closed, ResolvedPublic3 Estimated Story Points

Event Timeline

Ottomata claimed this task.
Ottomata raised the priority of this task from to Medium.
Ottomata updated the task description. (Show Details)
Ottomata added a project: Analytics-Clusters.
Ottomata added subscribers: Ottomata, Nuria, JAllemandou.

Change 201009 had a related patch set uploaded (by Ottomata):
Add oozie util workflow to launch spark jobs

https://gerrit.wikimedia.org/r/201009

oozie spark actions are available in CDH 5.4, to which we are upgrading on Monday.

Change 201009 abandoned by Ottomata:
Add oozie util workflow to launch spark jobs

Reason:
Oozie added built in support, so we don't need this!

https://gerrit.wikimedia.org/r/201009

Change 201009 restored by Ottomata:
Add oozie util workflow to launch spark jobs

Reason:
Resurrecting for T162610

https://gerrit.wikimedia.org/r/201009

Ottomata renamed this task from Make oozie work with spark jobs to Make oozie work with spark jobs that use HiveContext.May 5 2017, 3:26 PM
Ottomata reopened this task as Open.
Ottomata edited projects, added Analytics-Kanban; removed Analytics.
Ottomata set the point value for this task to 3.
Ottomata moved this task from Next Up to In Code Review on the Analytics-Kanban board.

Change 201009 merged by Ottomata:
[analytics/refinery@master] Add oozie util workflow to launch spark jobs

https://gerrit.wikimedia.org/r/201009