Page MenuHomePhabricator

For the new data pipeline, purge existing log files
Closed, ResolvedPublic

Description

Once we start getting test data that's worth comparing coming down the new data pipeline, let's purge previous json files from the servers, so that everything that gets ingressed into the test database is useful.

/srv/archive/banner_logs/201[89]/*json*

Thanks so much!!!!

Event Timeline

New data should be coming in fine, now, so we're ready for this any time. Thanks much!!!

Jgreen claimed this task.
Jgreen moved this task from Triage to Done on the fundraising-tech-ops board.
Jgreen subscribed.

I moved these files to a temporary directory /srv/purge_after_20191031 for now, which is out of the way of log collection, nfs, and log processing. We'll do a final purge sometime after that date.