Change Details

Let's setup an Airflow instance for WMDE folks. ==== Steps [x] Create WMDE airflow admin group - [x]send request for new system user - [x] disable `analytics-wmde` user on stat 1007 [x] an-airflow1007 keytabs [x] Create an-airflow1007 instance.( currently in ` role(insetup::data_engineering)`) [x] Create analytics-wmde user for an-airflow1007 [x] Create Airflow Postgresql Database [x] Create Airflow puppet configuration [x] Create the instance specific dags folder [] Create the instance specific scap repository (ready to merge) [x] Create WMDE service user [] Add service user to the Yarn production queue (in review) [] Update Documentation [] Announce to WMDE team ==== Success Criteria [] Instance is setup and a simple test job can be run [] Update details here -> https://wikitech.wikimedia.org/wiki/Data_Engineering/Systems/Airflow/Instances

Let's setup an Airflow instance for WMDE folks. ==== Steps [x] Create WMDE airflow admin group - [x]send request for new system user - [x] disable `analytics-wmde` user on stat 1007 [x] an-airflow1007 keytabs [x] Create an-airflow1007 instance.( currently in ` role(insetup::data_engineering)`) [x] Create analytics-wmde user for an-airflow1007 [x] Create Airflow Postgresql Database [x] Create Airflow puppet configuration [x] Create the instance specific dags folder [x] Create the instance specific scap repository [x] Create WMDE service user [x] Add service user to the Yarn production queue [x] Update Documentation [] Announce to WMDE team ==== Success Criteria [] Instance is setup and a simple test job can be run [] Update details here -> https://wikitech.wikimedia.org/wiki/Data_Engineering/Systems/Airflow/Instances

Let's setup an Airflow instance for WMDE folks. ==== Steps [x] Create WMDE airflow admin group - [x]send request for new system user - [x] disable `analytics-wmde` user on stat 1007 [x] an-airflow1007 keytabs [x] Create an-airflow1007 instance.( currently in ` role(insetup::data_engineering)`) [x] Create analytics-wmde user for an-airflow1007 [x] Create Airflow Postgresql Database [x] Create Airflow puppet configuration [x] Create the instance specific dags folder [x] Create the instance specific scap repository (ready to merge) [x] Create WMDE service user [x] Add service user to the Yarn production queue (in review) [x] Update Documentation [] Announce to WMDE team ==== Success Criteria [] Instance is setup and a simple test job can be run [] Update details here -> https://wikitech.wikimedia.org/wiki/Data_Engineering/Systems/Airflow/Instances