Page MenuHomePhabricator

[EventLoggingToDruid] Allow ingestion of simple-type arrays by converting them to strings
Closed, InvalidPublic

Description

Druid doesn't allow for array fields.
But if the array is of simple type (Array[String], Array[Int], Array[Boolean]), then we can stringify it and ingest it as a string.

Event Timeline

Should we sort the array before stringifying?
Like: [1,2] and [2,1] generate the same string "[1,2]"?
This would reduce the number of possible string values, and make differently ordered arrays match.
However, if the order in the array has a specific semantics, that would be lost in the stringification.

fdans triaged this task as Medium priority.Aug 16 2018, 3:39 PM
fdans moved this task from Incoming to Smart Tools for Better Data on the Analytics board.

After discussing with the team, it turns out Druid does allow ingestion of array types!
I tested that it works for this data set and indeed it does.
So, sorry for the confusion, my bad.
Will invalidate this task.