Page MenuHomePhabricator

Refactor quenename into HQL hive2 action oozie jobs
Closed, ResolvedPublic5 Story Points

Description

The change of hive to hive2 action in oozie has lead to mapreduce jobs generated by hive always running in the default queue, not in the production queue anymore.
I have managed to overcome the issue by passing the parameter as a beeline parameter in the hive2 action:

<argument>--hiveconf</argument>
<argument>mapreduce.job.queuename=${queue_name}</argument>

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptThu, Aug 22, 11:40 AM

Change 531682 had a related patch set uploaded (by Joal; owner: Joal):
[analytics/refinery@master] Update webrequest oozie job for yarn queue to work

https://gerrit.wikimedia.org/r/531682

fdans triaged this task as High priority.Thu, Aug 22, 5:06 PM
fdans moved this task from Incoming to Radar on the Analytics board.
fdans moved this task from Radar to Operational Excellence on the Analytics board.
JAllemandou updated the task description. (Show Details)Wed, Aug 28, 12:41 PM
Nuria moved this task from Next Up to In Code Review on the Analytics-Kanban board.

Change 531682 merged by Joal:
[analytics/refinery@master] Update oozie job for yarn queue to work

https://gerrit.wikimedia.org/r/531682

Nuria closed this task as Resolved.Wed, Sep 11, 9:48 PM
Nuria set the point value for this task to 5.