Page MenuHomePhabricator

Investigate dangling tables after Airflow 2.5.1 upgrade of an-airflow1004.eqiad.wmnet
Open, Needs TriagePublic

Description

After finishing T332031, the upgrade process moved some data over to temp tables . This results in a WARN shown on the Airflow UI:

While upgrading the metadatabase, Airflow had to move some bad data in order to apply new constraints. The moved data can be found in the following tables:
Source table	Table with moved rows
rendered_task_instance_fields	_airflow_moved__2_3__dangling__rendered_task_instance_fields
task_fail	_airflow_moved__2_3__dangling__task_fail
task_instance	_airflow_moved__2_2__dangling__task_instance
Please inspect the moved data to decide whether you need to keep them, and manually drop the moved tables to dismiss this warning. Read more about it in Upgrading.

In this task we should:

  1. Investigate the content of these tables
  2. Delete if unnecessary