We will likely need a script to do this. It may be possible that some python code I wrote in refinery can be used for this as is. It may need adapted.
Do we need to do this conditionally based on schemas? Do some schemas not get purged? If so, then perhaps we need to make schema purge settings part of EventCapsule.
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | • kevinator | T102225 {stag} EventLogging on Kafka | |||
| Resolved | • madhuvishy | T106253 Regularly purge EventLogging data in Hadoop {stag} [8 pts] |
Change 240299 had a related patch set uploaded (by Madhuvishy):
[WIP] Add script to drop old eventlogging partitions
Change 240449 had a related patch set uploaded (by Madhuvishy):
analytics: Add cron to drop Eventlogging data older than 90 days from hadoop
Change 240449 merged by Ottomata:
analytics: Add cron to drop Eventlogging data older than 90 days from hadoop