We have decided that we would like to upgrade our Airflow instances across the board to version 2.6.3
The current version is 2.5.1 and this upgrade was completed recently.
One of the purposes of this ticket is to ensure that we have a standard procedure for upgrading Airflow versions, whether they be major versions, minor versions, or point releases.
This task is intended to be the tracking task for the whole upgrade and subtasks will be generated as required. The following tasks will be required at a minimum:
- Ensure that we have the Airflow upgrade procedure documented on Wikitech
- Create a Debian package of Airflow 2.6.3
- Deploy the new version of Airflow to the analytics_test instance
- Test the analytics DAGs with the new version
- Upgrade all production instances
