Cleanup refinery artifacts folder from unneeded jars
For both in deployment depo and hadoop cluster . Right now we have about 8G of jars of which likely we only need half.
Cleanup refinery artifacts folder from unneeded jars
For both in deployment depo and hadoop cluster . Right now we have about 8G of jars of which likely we only need half.
Subject | Repo | Branch | Lines +/- | |
---|---|---|---|---|
Cleanup artifacts folder | analytics/refinery | master | +1 -176 |
Audit of versioned jar files needed (non-versioned files should always be there):
jar | Defined in |
camus-wmf-0.1.0-wmf9.jar | modules/profile/manifests/analytics/refinery/job/camus.pp and test/camus.pp |
refinery-camus-0.0.90.jar | modules/profile/manifests/analytics/refinery/job/camus.pp and test/camus.pp |
refinery-job-0.0.83.jar | modules/profile/manifests/analytics/refinery/job/druid_load.pp |
refinery-job-0.0.94.jar | modules/profile/manifests/analytics/refinery/job/refine.pp |
refinery-job-0.0.97.jar | modules/profile/manifests/analytics/refinery/job/test/refine.pp |
jar | Defined in |
refinery-job-0.0.61.jar | oozie/apis/coordinator.properties |
refinery-cassandra-0.0.35.jar | oozie/cassandra/bundle.properties and associated coordinators and historical workflow |
refinery-hive-0.0.53.jar | oozie/cassandra/bundle.properties and associated coordinators |
refinery-job-0.0.89.jar | oozie/clickstream/coordinator.properties |
refinery-hive-0.0.93.jar | spread between oozie/data_quality/coordinator.properties (version) and eventcapsule_metrics.hql(file) |
refinery-hive-0.0.53.jar | spread between oozie/interlanguage/daily/coordinator.properties (version) and interlanguage_navigation.hql(file) |
refinery-hive-0.0.41.jar | oozie/mediacounts/load/insert_hourly_mediacounts.hql |
refinery-hive-0.0.98.jar | spread between oozie/mediarequest/hourly/coordinator.properties (version) and mediarequest_hourly.hql(file) |
refinery-hive-0.0.53.jar | spread between oozie/mediawiki/geoeditors/monthly/coordinator.properties (version) and insert_geoeditors_daily_data.hql(file) |
refinery-job-0.0.93.jar | oozie/mediawiki/history/check_denormalize/coordinator.properties |
refinery-job-0.0.93.jar | oozie/mediawiki/history/denormalize/coordinator.properties |
refinery-job-0.0.88.jar | oozie/mediawiki/history/reduced/coordinator.properties |
refinery-job-0.0.85.jar | oozie/mediawiki/history/wikitext/coordinator.properties |
refinery-job-0.0.61.jar | oozie/mobile_apps/session_metrics/coordinator.properties |
refinery-hive-0.0.24.jar | spread between oozie/projectview/geo/coordinator.properties (version) and archive_projectview_geo_hourly.hql(file) |
refinery-hive-0.0.46.jar | oozie/unique_devices/per_project_family/daily/coordinator.properties |
refinery-hive-0.0.46.jar | oozie/unique_devices/per_project_family/monthly/coordinator.properties |
refinery-hive-0.0.58.jar | spread between oozie/virtualpageview/hourly/coordinator.properties (version) and virtualpageview_hourly.hql(file) |
refinery-hive-0.0.94.jar | spread between oozie/webrequest/load/bundle.properties (version) and refine_webrequest.hql(file) |
refinery-job-0.0.80.jar | oozie/webrequest/subset/coordinator.properties |
refinery-job-0.0.62.jar | oozie/wikidata/articleplaceholder_metrics/coordinator.properties |
refinery-job-0.0.89.jar | oozie/wikidata/coeditors_metrics/coordinator.properties |
refinery-job-0.0.61.jar | oozie/wikidata/specialentitydata_metrics/coordinator.properties |
Change 534611 had a related patch set uploaded (by Joal; owner: Joal):
[analytics/refinery@master] Cleanup artifacts folder