The Airflow install includes a Spark3 installation: /usr/lib/airflow/lib/python3.7/site-packages/pyspark/bin/spark-submit
This task is about trying to have a test airflow job using it. We'll need to:

• Make a Spark3 configuration from the existing Spark2 one
• Find the settings we need for the airflow job to work

Potential issues we already thought off: the Spark3 version has a different Hadoop version than the one we have that would generate incompatibility.

Extended:

• Puppetize the config once found
• Find the airflow assembly file and upload it to hadoop