To do this, we'd need to make sure that all consumers of streams are sensitive to canary events and able to filter them out. This includes mediawiki events from EventBus, and any other non Hive bound consumers.
|Open||None||T185233 Modern Event Platform|
|Open||Ottomata||T238230 Decommission EventLogging backend components by migrating to MEP|
|Resolved||Ottomata||T251609 Automate ingestion and refinement into Hive of event data from Kafka using stream configs and canary/heartbeat events|
|Open||Ottomata||T266798 Enable canary events for all streams|
|Open||Ottomata||T252585 Refine event pipeline at this time refines data in hourly partitions without knowing if the partition is complete|