Handle EventStream canary events gracefully
Closed, ResolvedPublic3 Estimated Story Points
Actions

Assigned To

Authored By

	• REsquito-WMF
	Oct 25 2023, 11:28 AM

Project Tags

Referenced Files

None

Subscribers

Aklapper

JArguello-WMF

• REsquito-WMF

Description

Background/Goal

As a WME Engineer i want to be sure the events we get from EventStreams are handled properly.

We have had a request from Event Platform team, mentioning that we should discard all events where meta.domain == "canary".

Acceptance Criteria

Changes deployed to dev and prod

Key Tasks

SDK changed to filter messages
Update EventBridge project with the new released version of the SDK
Deploy to Dev
QA ( may not be possible, but reach out to Event Platform team, specifically the owner of the ticket in artifacts )
Deploy to Prod

Artifacts & Resources

source of request: https://phabricator.wikimedia.org/T266798

Stepan
One more review

Details

Due Date: Nov 10 2023, 12:00 AM

Related Objects
Search...

Status	Assigned	Task
Resolved	Ottomata	T251609 Automate ingestion and refinement into Hive of event data from Kafka using stream configs and canary/heartbeat events
Resolved	Ottomata	T266798 [Event Platform] Enable canary events for all MediaWiki streams
Resolved	LDlulisa-WMF	T349697 Handle EventStream canary events gracefully

Event Timeline

• REsquito-WMF created this task.Oct 25 2023, 11:28 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 25 2023, 11:28 AM

• REsquito-WMF renamed this task from Change in streams to Handle EventStream canary events gracefully.Oct 25 2023, 11:36 AM

• REsquito-WMF triaged this task as High priority.

• REsquito-WMF set Due Date to Nov 6 2023, 12:00 AM.

• REsquito-WMF updated the task description. (Show Details)

• REsquito-WMF added a project: Wikimedia Enterprise Engineering.

• REsquito-WMF moved this task from Incoming to To Be Estimated/To Be Discussed- Migrating on the Wikimedia Enterprise board.

• REsquito-WMF mentioned this in T266798: [Event Platform] Enable canary events for all MediaWiki streams.Oct 25 2023, 11:41 AM

• REsquito-WMF updated the task description. (Show Details)Oct 25 2023, 11:44 AM

• REsquito-WMF changed Due Date from Nov 6 2023, 12:00 AM to Nov 10 2023, 12:00 AM.Oct 25 2023, 11:46 AM

JArguello-WMF set the point value for this task to 5.Oct 25 2023, 4:06 PM

JArguello-WMF moved this task from To Be Estimated/To Be Discussed- Migrating to Estimated /Discussed- Migrating on the Wikimedia Enterprise board.

JArguello-WMF changed the point value for this task from 5 to 3.Nov 2 2023, 2:02 PM

JArguello-WMF moved this task from Estimated /Discussed- Migrating to Sprint 50 on the Wikimedia Enterprise board.

JArguello-WMF edited projects, added: Wikimedia Enterprise (Sprint 50); removed: Wikimedia Enterprise.

LDlulisa-WMF claimed this task.Nov 6 2023, 12:30 PM

Ottomata added a parent task: T266798: [Event Platform] Enable canary events for all MediaWiki streams.Nov 6 2023, 2:14 PM

LDlulisa-WMF moved this task from Next Up to In Progress on the Wikimedia Enterprise (Sprint 50) board.Nov 6 2023, 2:37 PM

LDlulisa-WMF moved this task from In Progress to MR on the Wikimedia Enterprise (Sprint 50) board.Nov 9 2023, 11:48 AM

JArguello-WMF updated the task description. (Show Details)Nov 13 2023, 2:07 PM

Stephan will take a second look

Stephan and Prabhat will take a look again

JArguello-WMF edited projects, added: Wikimedia Enterprise (Sprint 51); removed: Wikimedia Enterprise (Sprint 50).Nov 16 2023, 2:32 PM

JArguello-WMF moved this task from Next Up to MR on the Wikimedia Enterprise (Sprint 51) board.

LDlulisa-WMF moved this task from MR to QA on the Wikimedia Enterprise (Sprint 51) board.Nov 20 2023, 9:14 AM

• REsquito-WMF moved this task from QA to Done on the Wikimedia Enterprise (Sprint 51) board.Nov 23 2023, 1:47 PM

JArguello-WMF closed this task as Resolved.Dec 4 2023, 2:53 PM

Handle EventStream canary events gracefullyClosed, ResolvedPublic3 Estimated Story PointsActions