Gather user feedback from druid prototype
Access prototype:
ssh -N stat1002.eqiad.wmnet -L 9090:stat1002.eqiad.wmnet:9090
and later go to http://localhost:9090
That's it
Gather user feedback from druid prototype
Access prototype:
ssh -N stat1002.eqiad.wmnet -L 9090:stat1002.eqiad.wmnet:9090
and later go to http://localhost:9090
That's it
First off- this is amazing. I can't wait to use this more. I used it last night to get a quick ballpark figure because using this new tool was already easier than existing methods.
Thanks for the feedback, @JKatzWMF. Most of the things you mention I agree with, but they're a bit out of scope for us because Pivot is a UI developed by Imply: https://github.com/implydata/pivot. We could fork and add easy features, like download as CSV, but that does get away from what we're trying to do this quarter and next.
Right now we're more focused on building the data pipeline and working out scalability and performance issues. So I guess what we'd like to know is, how useful this way of looking at data is in general compared to direct Hive access. We have a few other out-of-the-box-UI choices for you, including AirBnB's Caravel or Saiku (which we would have to pay a small fee to integrate with Druid). You also can submit queries directly to Druid but that comes with a cost of learning their weird query specification and the only benefit is a bit better speed than Hive. We'll ping this ticket when we have Caravel set up so you can take a look.
Actually Pivot lets you download a CSV by clicking the share icon in the top right corner. I just used that to create this spreadsheet.
(And yes, I agree it's an important feature, for example because the visualization options in Pivot are unsurprisingly a bit limited, e.g. it doesn't seem to be possible to create a stacked graph like in that example.)
Agree this looks great! And so fast!
It would be nice to be able to export a SQL (or HQL) query corresponding to the current setting (filters and splits), That could enable one to refine it using Hive once one hits the limits of the Pivot interface.
I seem to recall this was possible in some form with our Pentaho/Saiku installation last year. But I guess that may not be possible, as Druid uses a different query format internally. Does anyone know?
An option for exporting the current graph (+legend) as SVG or PNG would be great too.
@Tbayer: query format is indeed very different than the one you would use in hive. Also, query times and optimizations needed are different in either data store.