Page MenuHomePhabricator

Check home/HDFS leftovers of mholloway-shell
Closed, ResolvedPublic

Description

The access for Michael Holloway was removed. It needs to be checked if data was left in home dirs on stat*/notebook*/HDFS since they were part of the "analytics-privatedata-users" group.

The Kerberos principal has already been removed.

Event Timeline

odimitrijevic moved this task from Incoming to Ops Week on the Analytics board.
====== stat1004 ======
total 0

====== stat1005 ======
total 44
-rw-r--r-- 1 11963 wikidev 2478 Feb 12  2021 bundle.properties
-rw-r--r-- 1 11963 wikidev 6173 Feb 12  2021 bundle.xml
-rw-r--r-- 1 11963 wikidev 2473 Feb 12  2021 coordinator.xml
-rw-r--r-- 1 11963 wikidev 2956 Feb 12  2021 create_mediawiki_api_tables.hql
-rw-r--r-- 1 11963 wikidev 1471 Feb 12  2021 load-mediawiki_api_action_hourly.hql
-rw-r--r-- 1 11963 wikidev 1836 Feb 12  2021 load-mediawiki_api_param_hourly-delimited.hql
-rw-r--r-- 1 11963 wikidev 1792 Feb 12  2021 load-mediawiki_api_param_hourly.hql
-rw-r--r-- 1 11963 wikidev 1567 Feb 12  2021 load-mediawiki_api_ua_hourly.hql
-rw-r--r-- 1 11963 wikidev 5898 Feb 12  2021 workflow.xml

====== stat1006 ======
total 0

====== stat1007 ======
total 0

====== stat1008 ======
total 0

======= HDFS ========
Found 4 items
drwx------   - mholloway-shell mholloway-shell          0 2021-03-15 00:00 /user/mholloway-shell/.Trash
drwx------   - mholloway-shell mholloway-shell          0 2021-04-26 22:54 /user/mholloway-shell/.staging
drwxr-xr-x   - mholloway-shell mholloway-shell          0 2020-07-22 00:42 /user/mholloway-shell/mobile_apps_uniques_by_country
drwxr-x---   - mholloway-shell mholloway-shell          0 2021-02-12 23:05 /user/mholloway-shell/oozie-oozi

====== Hive =========
drwxr-x---   - mholloway-shell  analytics-privatedata-users          0 2021-02-12 18:40 /user/hive/warehouse/mholloway.db/action_action_hourly
drwxr-x---   - mholloway-shell  analytics-privatedata-users          0 2021-02-12 18:40 /user/hive/warehouse/mholloway.db/action_param_hourly
drwxr-x---   - mholloway-shell  analytics-privatedata-users          0 2021-02-12 20:20 /user/hive/warehouse/mholloway.db/mediawiki_api_action_hourly
drwxr-x---   - mholloway-shell  analytics-privatedata-users          0 2021-02-12 21:43 /user/hive/warehouse/mholloway.db/mediawiki_api_param_hourly
drwxr-x---   - mholloway-shell  analytics-privatedata-users          0 2021-02-12 21:22 /user/hive/warehouse/mholloway.db/mediawiki_api_ua_hourly

@jlinehan @dr0ptp4kt can you please review the above and let us know if any of the data needs to be kept?

@jlinehan @dr0ptp4kt putting this on your radar again.

Thanks, I don't think any of this needs to be kept, you can proceed.

Done:

sudo cumin 'C:profile::analytics::cluster::client or C:profile::hadoop::master or C:profile::hadoop::master::standby' 'rm -rf /home/mholloway-shell'
DROP DATABASE mholloway CASCADE;
sudo -u hdfs kerberos-run-command hdfs hdfs dfs -rm -r /user/mholloway-shell /user/hive/warehouse/mholloway.db
Ottomata claimed this task.