Page MenuHomePhabricator

Switch off skipTrash for some data purging
Open, HighPublic

Description

As a measure to protect against accidental data deletion, we decided to remove the --skipTrash flag from some deletion commands.

Event Timeline

JAllemandou renamed this task from Switch off skipTrash for data purging to Switch off skipTrash for some data purging.Dec 18 2020, 7:38 AM
JAllemandou updated the task description. (Show Details)

I think that jobs where skipTrash should be removed are the one applying purge to multiple sub-folders at once (events for instance). Jobs applying to well defined folder/datasets should probably keep the skipTrash as the risk to have data in those folders that shouldn't be deleted is very small.
If we agree on the above, purge jobs to skipTrash are:

  • Raw events
  • Refined events

Agree!

I think this would then be:

/wmf/data/raw/eventlogging
/wmf/data/raw/event
/wmf/data/event
/wmf/data/event_sanitized
fdans triaged this task as High priority.
fdans moved this task from Incoming to Security Maturity and Data Privacy on the Analytics board.