Some years ago we got approval to update our query_clicks data processing pipeline and update our retention times to 13 months. This still needs to be implemented. For the most part this is adjusting the query_clicks hourly and daily airflow dags to follow the requirements set forth in the approval.
Related approval: https://phabricator.wikimedia.org/T235858
gmodena opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1105
Draft: search: query_clicks: hash session ids
gmodena merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1105
search: query_clicks: increase data retention
gmodena opened https://gitlab.wikimedia.org/repos/search-platform/mjolnir/-/merge_requests/13
fix: pass start_date and end_date to query_clicks.transformer
gmodena opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1179
search: mjolnir: fix query_clicks_ltr date argument order
ebernhardson merged https://gitlab.wikimedia.org/repos/search-platform/mjolnir/-/merge_requests/13
fix: pass start_date and end_date to query_clicks.transformer
gmodena merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1179
search: mjolnir: fix query_clicks_ltr date argument order
gmodena opened https://gitlab.wikimedia.org/repos/search-platform/mjolnir/-/merge_requests/14
Draft: cli: refactor start/end date params.
gmodena opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1186
Draft: search: mjolnir: version bump mjolnir dep
gmodena merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1186
search: mjolnir: version bump mjolnir dep