Page MenuHomePhabricator

Remove delete events from snapshots
Closed, ResolvedPublic5 Estimated Story Points

Description

We need to add a parameter to remove delete events ending up in snapshots, so that we don't grow the snapshtos size with unnecessary data.

At the moment we use the same service for snapshots and batches generation, we need to be able to provide event_types or any other parameter to the Export endpoint so that we can control what event types endup in the result file.

Acceptance criteria
Delete events are no longer present in snapshots.

ToDo

  • update Export endpoint in snapshots to give the ability to filter out different events
  • update scheduler snapshots DAG to provide that parameter (will need to re-generate the proto files)
  • deploy to dev environment and test

Related Objects

StatusSubtypeAssignedTask
OpenNone
ResolvedTim.abdullin

Event Timeline

Tim.abdullin changed the task status from Open to In Progress.Mar 2 2023, 4:13 PM
Tim.abdullin claimed this task.
Tim.abdullin set the point value for this task to 5.Mar 6 2023, 8:23 AM