Data for events from wdqs needs to be deleted after 90 days and/or sanitized similarly to how it is done for cirrus. There is also the option to sanitize data and kept part of it longterm
There are two different events persisted to two different directories so data needs to be sanitized for both.
/wmf/data/event/wdqs_external_sparql_query
/wmf/data/event/wdqs_internal_sparql_query/
| Subject | Repo | Branch | Lines +/- | |
|---|---|---|---|---|
| profile::analytics::refinery::job::data_purge: purge wdqs query logs | operations/puppet | production | +2 -0 |
Change 577469 had a related patch set uploaded (by DCausse; owner: DCausse):
[operations/puppet@production] [wdqs] purge wdqs query logs
@dcausse similar to cirrus data some data can be kept long term if it is on the sanitization list, let us know if you want to do that
Change 577469 merged by Elukey:
[operations/puppet@production] profile::analytics::refinery::job::data_purge: purge wdqs query logs