Page MenuHomePhabricator

Move eventlogging_to_druid_ jobs to airflow in order to rely on cluster spark mechanism instead of client
Closed, DeclinedPublic

Description

In order to avoid using all the network on an-launcher1002 and leading to sql connection issues between airflow and the DB we must move those systemd timer based job eventlogging_to_druid_* to airflow relying on skein and ensuring spark job run in cluster mode