Page MenuHomePhabricator

Event Platform schemas should not support type changes to structs as array element or map value types
Open, Needs TriagePublic5 Estimated Story Points

Description

There are complicated issue when we try alter Hive & Iceberg tables that have structs as array or map value element types.

Complicated context in:

Currently jsonschema-tools will allow for backwards compatible changes to array and map element struct types.

We should make a configurable change to jsonschema-tools that will fail if a user tries to make a change to a struct element type.

Without this change, it is possible for Event Platform users to make schema changes that will cause our event ingestion pipeline (Refine) to fail.

Done is

Related Objects

Event Timeline

Ottomata updated the task description. (Show Details)