Page MenuHomePhabricator

[EventLoggingToDruid] Allow ingestion of simple-type arrays by converting them to strings
Closed, InvalidPublic


Druid doesn't allow for array fields.
But if the array is of simple type (Array[String], Array[Int], Array[Boolean]), then we can stringify it and ingest it as a string.

Event Timeline

mforns created this task.Aug 13 2018, 8:04 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptAug 13 2018, 8:04 PM

Should we sort the array before stringifying?
Like: [1,2] and [2,1] generate the same string "[1,2]"?
This would reduce the number of possible string values, and make differently ordered arrays match.
However, if the order in the array has a specific semantics, that would be lost in the stringification.

fdans triaged this task as Medium priority.Aug 16 2018, 3:39 PM
fdans moved this task from Incoming to Smart Tools for Better Data on the Analytics board.
mforns closed this task as Invalid.Oct 2 2018, 1:29 PM

After discussing with the team, it turns out Druid does allow ingestion of array types!
I tested that it works for this data set and indeed it does.
So, sorry for the confusion, my bad.
Will invalidate this task.