As on operator of WDQS / WCQS, I want to deploy Flink in a way that is robust so that we can deploy WDQS Streaming updater on top of it.
The strategy as discussed in part in T247058 is to use k8s to provide compute resources and Swift as storage. Communication with the teams in charge of k8s and Flink has already started, but our needs have to be formalized, and the concrete strategy for implementation needs to be defined.
- Flink is deployed on a production k8s cluster
- stream of TTL update is available in Kafka and ready to be consumed