Change Details

Refactor some refinery python utils and scripts to be smarter about infering Hive table and HDFS path partitions, and automatically purge after N days. This should also work with many tables at once.

Refactor some refinery python utils and scripts to be smarter about infering Hive table and HDFS path partitions, and automatically purge after N days (based on the [[https://wikitech.wikimedia.org/wiki/Analytics/Systems/EventLogging/Data_retention_and_auto-purging | existing purging strategies]]). This should also work with many tables at once.

Refactor some refinery python utils and scripts to be smarter about infering Hive table and HDFS path partitions, and automatically purge after N days (based on the [[https://wikitech.wikimedia.org/wiki/Analytics/Systems/EventLogging/Data_retention_and_auto-purging | existing purging strategies]]). This should also work with many tables at once.