Currently, only the producer is aware of canary events in its source streams and skips them. However, also the update stream has canary events enabled (by default)
Canary events are necessary to prevent losing the committed/consumed kafka topic offsets, see comment.
AC
| Title | Reference | Author | Source Branch | Dest Branch | |
|---|---|---|---|---|---|
| pull up common filters (wiki-based, canary events) | repos/search-platform/cirrus-streaming-updater!47 | pfischer | common-canary-handling | main |
pfischer opened https://gitlab.wikimedia.org/repos/search-platform/cirrus-streaming-updater/-/merge_requests/47
pull up common filters (wiki-based, canary events)
dcausse merged https://gitlab.wikimedia.org/repos/search-platform/cirrus-streaming-updater/-/merge_requests/47
pull up common filters (wiki-based, canary events)