Page MenuHomePhabricator

Enable Refine event tables to Iceberg
Open, Needs TriagePublic

Description

This task is about enabling the ingestion of Event Platform streams into WMF Data Lake Iceberg tables.

Much of the implementation work has already been done as part of T356762: [Refine refactoring] Refine jobs should be scheduled by Airflow: implementation.

This task is not about migrating all existent event.* Hive tables to Iceberg.

Note that if we do this, the ingested tables can use actual timestamp types rather than ISO8601 strings.

Done is

Related Objects

Event Timeline