Page MenuHomePhabricator

Grant user knissen access to Hue
Closed, ResolvedPublic

Description

I'd like to request access to Hue. I'm already a member of nda in LDAP (requested in T241838).

  • Wikitech username: Kai Nissen (WMDE)
  • Shell username: knissen
  • Email address: kai.nissen@wikimedia.de

Please let me know if you need more information.

Event Timeline

Hi! We are trying to move users away from Hue if possible, what is your use case? Have you tried, by any chance, https://superset.wikimedia.org/superset/sqllab ?

My use case is to request data from event.WMDEBanner* tables. I'm using beeline right now, but find it hard to read at times.

We're planning to request ingestion of Hive data to Druid for these tables anyway, so I guess that should be the solution.

My use case is to request data from event.WMDEBanner* tables. I'm using beeline right now, but find it hard to read at times.

We're planning to request ingestion of Hive data to Druid for these tables anyway, so I guess that should be the solution.

Superset is now able to use Presto, a tool that is basically wrapping hive/beeline providing a faster data access. You should be able to query the tables that you need following:

https://wikitech.wikimedia.org/wiki/Analytics/Systems/Superset#SQL_Lab

Basically:

  1. Connect to https://superset.wikimedia.org/superset/sqllab
  2. select the presto_analytics_hive database in the top-left corner
  3. then "event" as schema
  4. and finally the table that you want.

Let me know if it works!

Great, that's all I need! Sorry, I missed the documentation update.

Does that mean, I can also just add event.wmdebanner* tables as described in Analytics/Systems/Superset#Druid_datasources_vs_Druid_tables to make them available to charts?

Great, that's all I need! Sorry, I missed the documentation update.

Does that mean, I can also just add event.wmdebanner* tables as described in Analytics/Systems/Superset#Druid_datasources_vs_Druid_tables to make them available to charts?

The documentation that you pointed out is related to druid datasources, so basically after hive when we index data into Druid (but I think that we are still not doing it for wmdebanner* right?). The steps that I pointed out above should allow you to basically use Presto/Superset to query hive's datasources via SQL-like language. It should be as if you were using beeline on the command line. If you have doubts let's chat on IRC! :)

kai.nissen claimed this task.

Yes, it works fine! I was already going beyond and trying

The documentation that you pointed out is related to druid datasources, so basically after hive when we index data into Druid (but I think that we are still not doing it for wmdebanner* right?).

Yes, I was already going beyond the scope of this ticket. The tables are not in druid. I can add them as tables (as described in the documentation), but it seems that they need more configuration to be actually used in superset charts.

The steps that I pointed out above should allow you to basically use Presto/Superset to query hive's datasources via SQL-like language. It should be as if you were using beeline on the command line. If you have doubts let's chat on IRC! :)

And that works perfectly fine!