Maniphest T316555

Use RowTypeInfo to ensure better validation of the event data within the Mediawiki Stream Enrichment pipeline
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	gmodena
	Aug 29 2022, 2:54 PM

Tags

Referenced Files

None

Subscribers

Description

We should leverage on the type system to process Row types in the Mediawiki Stream Enrichment.

@dcausse provided a sample implementation at https://gitlab.wikimedia.org/repos/data-engineering/mediawiki-stream-enrichment/-/merge_requests/13 - we should do an integration test and merge the changes.

References

https://gitlab.wikimedia.org/repos/data-engineering/mediawiki-stream-enrichment/-/merge_requests/12#note_9718

Related Objects

Mentioned In: T311084: [Shared Event Platform] Mediawiki Stream Enrichment should consume the consolidated page-change stream.
Mentioned Here: T311084: [Shared Event Platform] Mediawiki Stream Enrichment should consume the consolidated page-change stream.

Event Timeline

gmodena created this task.Aug 29 2022, 2:54 PM

Restricted Application added a project: Data-Engineering. · View Herald TranscriptAug 29 2022, 2:54 PM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

gmodena moved this task from Backlog to Sprint 00 on the Event-Platform board.Aug 30 2022, 8:30 AM

gmodena edited projects, added Event-Platform (Sprint 00); removed Event-Platform.

gmodena moved this task from Next Up to In Progress on the Event-Platform (Sprint 00) board.Aug 30 2022, 10:01 AM

These changes have been merged into https://gitlab.wikimedia.org/repos/data-engineering/mediawiki-stream-enrichment/-/merge_requests/12, which is part of https://phabricator.wikimedia.org/T311084.

gmodena mentioned this in T311084: [Shared Event Platform] Mediawiki Stream Enrichment should consume the consolidated page-change stream..Aug 30 2022, 8:21 PM

JArguello-WMF moved this task from In Review to Done on the Event-Platform (Sprint 00) board.Aug 31 2022, 1:01 PM

JArguello-WMF closed this task as Resolved.Sep 1 2022, 12:13 PM