Maniphest T197889

Drop mediawiki history old snapshots from druid public cluster
Closed, ResolvedPublic13 Estimated Story Points
Actions

Assigned To

Authored By

	• Nuria
	Jun 21 2018, 5:23 PM

Description

Drop mediawiki history old snapshots from druid public cluster

Every time we load new data into druid public cluster we are loading a new snapshot (since Q4 2018) ,
while we want to keep some snapshots (probably 3) to make sure we always can rollback to last month data,
we do not want to be indexing data w/o deleting old snapshots we are no longer using.

Details

	Subject	Repo	Branch	Lines +/-
	Add druid snapshot removal cron job	operations/puppet	production	+32 -14
	Add druid snapshot deletion script	analytics/refinery	master	+168 -0

Customize query in gerrit

Event Timeline

• Nuria created this task.Jun 21 2018, 5:23 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 21 2018, 5:23 PM

• Nuria updated the task description. (Show Details)Jun 21 2018, 5:24 PM

• Vvjjkkii renamed this task from Drop mediawiki history old snapshots from druid public cluster to eiaaaaaaaa.Jul 1 2018, 1:02 AM

• Vvjjkkii triaged this task as High priority.

• Vvjjkkii added projects: CheckUser, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), Tamil-Sites, Gamepress, Hashtags, Jade, KartoEditor, Language-2018-Apr-June, New-Editor-Experiences, Mail, TCB-Team (now WMDE-TechWish).

• Vvjjkkii updated the task description. (Show Details)

• Vvjjkkii removed a subscriber: Aklapper.

CommunityTechBot renamed this task from eiaaaaaaaa to Drop mediawiki history old snapshots from druid public cluster.Jul 2 2018, 11:19 AM

CommunityTechBot raised the priority of this task from High to Needs Triage.

CommunityTechBot updated the task description. (Show Details)

CommunityTechBot removed projects: TCB-Team (now WMDE-TechWish), Mail, New-Editor-Experiences, Language-2018-Apr-June, KartoEditor, Jade, Hashtags, Gamepress, Tamil-Sites, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), CheckUser.

CommunityTechBot added a subscriber: Aklapper.

• fdans triaged this task as High priority.Jul 2 2018, 4:06 PM

• fdans moved this task from Incoming to Smart Tools for Better Data on the Analytics board.

• Nuria assigned this task to • fdans.Jul 16 2018, 6:59 PM

• Nuria raised the priority of this task from High to Needs Triage.Jul 16 2018, 7:03 PM

• fdans added a project: Analytics-Kanban.Jul 27 2018, 2:56 PM

• fdans moved this task from Next Up to In Code Review on the Analytics-Kanban board.

Change 448551 had a related patch set uploaded (by Fdans; owner: Fdans):
[analytics/refinery@master] Add druid snapshot deletion script

https://gerrit.wikimedia.org/r/448551

gerritbot added a project: Patch-For-Review.Jul 27 2018, 2:57 PM

Milimetric triaged this task as Medium priority.Jul 31 2018, 3:11 PM

Milimetric set the point value for this task to 5.

• fdans moved this task from In Code Review to Ready to Deploy on the Analytics-Kanban board.Aug 27 2018, 1:58 PM

• fdans changed the point value for this task from 5 to 8.

• fdans changed the point value for this task from 8 to 13.

Change 448551 merged by Fdans:
[analytics/refinery@master] Add druid snapshot deletion script

https://gerrit.wikimedia.org/r/448551

• Nuria moved this task from Ready to Deploy to In Code Review on the Analytics-Kanban board.Aug 27 2018, 3:05 PM

Change 455605 had a related patch set uploaded (by Fdans; owner: Fdans):
[operations/puppet@production] Add druid snapshot removal cron job

https://gerrit.wikimedia.org/r/455605

Change 455605 merged by Elukey:
[operations/puppet@production] Add druid snapshot removal cron job

https://gerrit.wikimedia.org/r/455605

• fdans moved this task from In Code Review to Done on the Analytics-Kanban board.Aug 31 2018, 10:34 AM

• Nuria closed this task as Resolved.Aug 31 2018, 3:07 PM

Drop mediawiki history old snapshots from druid public clusterClosed, ResolvedPublic13 Estimated Story PointsActions

Description

Details

Event Timeline

Drop mediawiki history old snapshots from druid public cluster
Closed, ResolvedPublic13 Estimated Story Points
Actions