Page MenuHomePhabricator
Create Task
Maniphest T283258

Provide a job regularly deleting wdqs processed query after 90 days
Closed, ResolvedPublic
Actions

Description

This task is related to T273854. When the job generating hourly query-info is launched, we should make sure we also delete the data after 90 days to be within our data-retention policy.

Details

SubjectRepoBranchLines +/-
Airflow dag to extract and process sparql querieswikimedia/discovery/analyticsmaster+221 -2
Customize query in gerrit

Related Objects
Search...

Event Timeline

JAllemandou created this task.May 20 2021, 4:28 PM
Restricted Application removed a project: Patch-For-Review. · View Herald TranscriptMay 20 2021, 4:28 PM
CBogen moved this task from Incoming to Current work on the Wikidata-Query-Service board.May 27 2021, 1:43 PM
CBogen moved this task from Current work to Analysis on the Wikidata-Query-Service board.May 27 2021, 1:51 PM
CBogen removed a project: Discovery-Search (Current work).May 27 2021, 1:54 PM
gerritbot added a comment.Jun 10 2021, 7:02 AM

Change 698799 had a related patch set uploaded (by AKhatun; author: AKhatun):

[wikimedia/discovery/analytics@master] Airflow dag to extract and process sparql queries

https://gerrit.wikimedia.org/r/698799

gerritbot added a project: Patch-For-Review.Jun 10 2021, 7:02 AM
• MPhamWMF triaged this task as High priority.Jun 10 2021, 1:40 PM
• MPhamWMF moved this task from Analysis to Current work on the Wikidata-Query-Service board.
• MPhamWMF added a project: Discovery-Search (Current work).
• MPhamWMF moved this task from Incoming to In Progress on the Discovery-Search (Current work) board.Jun 10 2021, 3:08 PM
dcausse moved this task from In Progress to Needs review on the Discovery-Search (Current work) board.Jun 14 2021, 3:31 PM
gerritbot added a comment.Jun 21 2021, 5:42 PM

Change 698799 merged by jenkins-bot:

[wikimedia/discovery/analytics@master] Airflow dag to extract and process sparql queries

https://gerrit.wikimedia.org/r/698799

• AKhatun_WMF mentioned this in rWDAN58fc22bef150: Airflow dag to extract and process sparql queries.Jun 21 2021, 5:43 PM
EBernhardson moved this task from Needs review to Needs Reporting on the Discovery-Search (Current work) board.Jun 21 2021, 8:45 PM
• AKhatun_WMF moved this task from Current work to Analysis on the Wikidata-Query-Service board.Jun 22 2021, 7:46 AM
dcausse moved this task from Analysis to Current work on the Wikidata-Query-Service board.Jun 24 2021, 1:45 PM
Gehel closed this task as Resolved.Jul 26 2021, 12:14 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits