As part of the flink review with ververica here are the few points we agreed to exeriment before our next meeting in January:
- Remove non-optimized reordering
- remove unnecessary chained operators (e.g. routing to side outputs can be done directly inside the same process function)
- cleanup unnecessary serialization of the Patch class, might just be necessary to declare the Statement interface to Kryo
- use of DataStreamUtils#reinterpretAsKeyedStream(DataStream<T>, KeySelector<T,K>) and possibly use the KeyedStream signature a bit more
- try to drop custom parallelism
- Enable Object reuse
- Test unnaligned checkpoints on backfills