Change Details

To avoid repeated data quality alarms (the ones we have from Oozie right now), we should separate the RSVD part of the data quality pipeline to be executed by a systemd timer, so that its output can be used by Icinga to alarm. Icinga will then hendle state and only alarm once in case of consecutive anomalies on the same metric group.

To avoid repeated data quality alarms (the ones we have from Oozie right now), we should make the data quality job only alert when the list of anomalous metrics changes, for example, when it changes from: ``` [no anomalous metrics] ``` to ``` metric1 45 metric2 23 ``` or when it changes from ``` metric1 45 metric2 23 ``` to ``` metric1 45 metric2 23 metric3 65 ```

To avoid repeated data quality alarms (the ones we have from Oozie right now), we should separate the RSVD part ofmake the data quality job only alert when the data quality pipeline to be executed by a systemd timer,list of anomalous metrics changes, for example, when it changes from: so that its output can be used by Icinga to alarm.``` Icinga will then hendle state and only alarm once in case of consecutive anomalies on the same metric group.[no anomalous metrics] ``` to ``` metric1 45 metric2 23 ``` or when it changes from ``` metric1 45 metric2 23 ``` to ``` metric1 45 metric2 23 metric3 65 ```