Page MenuHomePhabricator

[Search Update Pipeline] Set max parallelism explicitely on operators with a state
Open, Needs TriagePublic

Description

Max parallelism should be hardcoded in the application and set explicitely on the flink job and/or operators that have a keyed state (windows).

Reference: https://nightlies.apache.org/flink/flink-docs-release-1.16/docs/ops/production_ready/

AC:

  • max parallelism is hard-coded and set on operators that require it

Event Timeline

bking renamed this task from [Search Update Pipeline] Set max pallelism explicitely on operators with a state to [Search Update Pipeline] Set max parallelism explicitely on operators with a state.Tue, Sep 19, 7:20 PM