We plan to use actor signature metrics, generated for bot detection, as a signal to monitor regressions on webrequest data.
We should add a DQ job to report metrics on webrequest_actor_metrics_hourly.
We plan to use actor signature metrics, generated for bot detection, as a signal to monitor regressions on webrequest data.
We should add a DQ job to report metrics on webrequest_actor_metrics_hourly.
Subject | Repo | Branch | Lines +/- | |
---|---|---|---|---|
refinery-job: add webrequest instrumentation. | analytics/refinery/source | master | +208 -6 |
Title | Reference | Author | Source Branch | Dest Branch | |
---|---|---|---|---|---|
Draft: analytics: webrequest: actor: add dq job | repos/data-engineering/airflow-dags!650 | gmodena | add-actor-metrics-reporting | main |
Status | Subtype | Assigned | Task | ||
---|---|---|---|---|---|
Open | gmodena | T354694 [Maintenance] Safeguard VarnishKafka to HAProxy analytics transition | |||
Open | gmodena | T362783 Add instrumentation for actor signatures |
gmodena updated https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/650
Draft: analytics: webrequest: actor: add dq job
Change #1019867 had a related patch set uploaded (by Gmodena; author: Gmodena):
[analytics/refinery/source@master] refinery-job: add webrequest instrumentation.