Page MenuHomePhabricator

Deprecate Hue (if possible)
Closed, DeclinedPublic

Description

The Hue daemon is provided by a Cloudera CDH package, and it currently shows some issues:

  1. It is not compatible with Python3, and we'd need to package the new open-source version provided by Cloudera in case it was needed.
  2. We are migrating to Apache BigTop (leaving the Cloudera distro), that doesn't include Hue due to issue in packaging.
  3. Most of the Hue's use cases could be covered by other tools.

There are two main use cases for Hue:

  1. Analytics team (and others) checking the status of Oozie jobs. Long term we'd like to migrate to a different scheduling tool, like Apache Airflow, but until then this use case prevents any deprecation of Hue of course.
  2. Data exploration via Hive query editor. This use case could be replaced by Superset's sqllab (https://wikitech.wikimedia.org/wiki/Analytics/Systems/Superset#SQL_Lab).

The first step of this task should be to ensure that the use case 2) is removed, then 1) will follow when a new scheduling tool will be available.

Event Timeline

In T258768 the Analytics team is trying to upgrade Hue to a new version, packaging the upstream code directly rather than relying on distributions (like CDH). For the moment I am closing this task since we'll support Hue for more time.