Change Details

In order to support Map types in JSON data, as well as to use the proper integer vs. decimal types, we need to examine the JSONSchema for event data during refinement. Once done, we will be able to convert schemas with ``` map_field: type: object additionalProperties: type: string # Or whatever the map value type is integer_field: type: integer decimal_field: type: number ``` This will allow us to use JSON data like: ``` {"map_field": {"key1": "val1", "key2", "val2"}, "integer_field": 1.2, "decimal_field": 2} ``` And automatically create Hive tables like ``` `map_field` map<string,string>, `integer_field` bigint, `decimal_field` double ```

In order to support Map types in JSON data, as well as to use the proper integer vs. decimal types, we need to examine the JSONSchema for event data during refinement. Once done, we will be able to convert schemas with ``` map_field: type: object additionalProperties: type: string # Or whatever the map value type is integer_field: type: integer decimal_field: type: number ``` This will allow us to use JSON data like: ``` {"map_field": {"key1": "val1", "key2", "val2"}, "integer_field": 2, "decimal_field": 1.2} ``` And automatically create Hive tables like ``` `map_field` map<string,string>, `integer_field` bigint, `decimal_field` double ```

In order to support Map types in JSON data, as well as to use the proper integer vs. decimal types, we need to examine the JSONSchema for event data during refinement. Once done, we will be able to convert schemas with ``` map_field: type: object additionalProperties: type: string # Or whatever the map value type is integer_field: type: integer decimal_field: type: number ``` This will allow us to use JSON data like: ``` {"map_field": {"key1": "val1", "key2", "val2"}, "integer_field": 1.2, "decimal_field": 2}1.2} ``` And automatically create Hive tables like ``` `map_field` map<string,string>, `integer_field` bigint, `decimal_field` double ```