[Data Quality] [NEEDS GROOMING][SPIKE] Define how we can validate that mw.page_content_change is complete
Open, Needs TriagePublic
Actions

Assigned To

None

Authored By

	lbowmaker
	Sep 8 2023, 1:18 PM

Description

User Story

As a platform engineer, I need to determine if the mw.page_content_change is a complete dataset

Why?

So that we can inform consumers of potential issues and try to see if we can make changes upstream to improve completeness.

Discussion points?

How do we do it? Can we diff a history table of revisions vs the stream periodically?

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		lbowmaker	T345912 [Data Quality] SDS3.3 - Logging, Monitoring and Alerting Improvements for Data Quality Incidents
		Open		None	T345917 [Data Quality] [NEEDS GROOMING][SPIKE] Define how we can validate that mw.page_content_change is complete

Event Timeline

lbowmaker created this task.Sep 8 2023, 1:18 PM

lbowmaker moved this task from Data Eng Backlog to SDS3.3 - Data Quality on the Data Engineering and Event Platform Team board.

Ahoelzl renamed this task from [NEEDS GROOMING][SPIKE] Define how we can validate that mw.page_content_change is complete to [Data Quality] [NEEDS GROOMING][SPIKE] Define how we can validate that mw.page_content_change is complete.Oct 20 2023, 5:06 PM

lbowmaker edited projects, added Data-Engineering; removed Data Engineering and Event Platform Team.Nov 10 2023, 1:36 PM

lbowmaker moved this task from Incoming (new tickets) to SDS3.3 - Data Quality on the Data-Engineering board.Nov 10 2023, 1:37 PM

[Data Quality] [NEEDS GROOMING][SPIKE] Define how we can validate that mw.page_content_change is completeOpen, Needs TriagePublicActions