Page MenuHomePhabricator

[Iceberg] Migrate event_sanitized_iceberg to event_sanitized
Open, Needs TriagePublic9 Estimated Story Points

Description

Once T311739: [Iceberg] Update Refine Sanitize to insert into Iceberg tables is done and working, we will need to replace the event_sanitized database with the iceberg version:

  • Announce to users
  • Have users do some testing in event_sanitized_iceberg, including testing with superset

Migration:

  • Rename event_sanitized to event_sanitized_hive, rename event_sanitized_iceberg to event_sanitized
  • Modify superset dashboards to use timestamp based (instead of partition based) queries.
  • Eventually: delete event_sanitized_hive database

Event Timeline

Ottomata renamed this task from [Iceburg] Create corresponding event_sanitized tables with Iceberg to [Iceberg] Migrate event_sanitized_iceberg to event_sanitized.Jun 30 2022, 3:51 PM
Ottomata updated the task description. (Show Details)

Please do add also codebase project tags to tasks and not only team tags as WMF loves to change teams.

We should do T225751: Consider renaming event and event_sanitized Hive databases along the way, getting the semantics of these different databases correct.