Page MenuHomePhabricator

Check home/HDFS leftovers of chandra-wmde
Closed, ResolvedPublic

Description

The access for Chandra Prakash (chandra-wmde) was removed. It needs to be checked if data was left in home dirs on stat*/HDFS since they were part of the "analytics-privatedata-users" group.

The Kerberos principal has already been removed. The point of contact for for the data in stat/HDFS is Cynthia Makonyango <cynthia.makonyango@wikimedia.de>

Event Timeline

brouberol changed the task status from Open to In Progress.Mar 11 2026, 11:52 AM
brouberol claimed this task.

These HDFS directories only contained data owned by chandra-wmde and I've gotten the go-ahead from @Andrew-WMDE to delete everything owned by this previous contractor.

brouberol@an-master1003:~$ sudo -u hdfs /usr/bin/hdfs dfs -rm -r /user/hive/warehouse/wmde_template_search_analytics/
26/03/11 12:00:56 INFO fs.TrashPolicyDefault: Moved: 'hdfs://analytics-hadoop/user/hive/warehouse/wmde_template_search_analytics' to trash at: hdfs://analytics-hadoop/user/hdfs/.Trash/Current/user/hive/warehouse/wmde_template_search_analytics
brouberol@an-master1003:~$ sudo -u hdfs /usr/bin/hdfs dfs -rm -r /user/chandra-wmde
26/03/11 12:02:04 INFO fs.TrashPolicyDefault: Moved: 'hdfs://analytics-hadoop/user/chandra-wmde' to trash at: hdfs://analytics-hadoop/user/hdfs/.Trash/Current/user/chandra-wmde
brouberol@an-master1003:~$

I've also deleted their files on stat1010:

brouberol@cumin1003:~$ sudo cumin 'stat1*' 'ls /home/chandra-wmde'
4 hosts will be targeted:
stat[1008-1011].eqiad.wmnet
OK to proceed on 4 hosts? Enter the number of affected hosts to confirm or "q" to quit: 4
===== NODE GROUP =====
(1) stat1010.eqiad.wmnet
----- OUTPUT of 'ls /home/chandra-wmde' -----
analytics
temp_data
Untitled1.ipynb
Untitled.ipynb
================
PASS |███████████████████████████████████████████████████████████████████████████| 100% (4/4) [00:00<00:00,  7.61hosts/s]
FAIL |                                                                                   |   0% (0/4) [00:00<?, ?hosts/s]
100.0% (4/4) success ratio (>= 100.0% threshold) for command: 'ls /home/chandra-wmde'.
100.0% (4/4) success ratio (>= 100.0% threshold) of nodes successfully executed all commands.
brouberol@cumin1003:~$ sudo cumin 'stat1*' 'rm  -r /home/chandra-wmde/*'
4 hosts will be targeted:
stat[1008-1011].eqiad.wmnet
OK to proceed on 4 hosts? Enter the number of affected hosts to confirm or "q" to quit: 4
===== NODE GROUP =====
(3) stat[1008-1009,1011].eqiad.wmnet
----- OUTPUT of 'rm  -r /home/chandra-wmde/*' -----
rm: cannot remove '/home/chandra-wmde/*': No such file or directory
================
PASS |██████████████████▊                                                        |  25% (1/4) [00:01<00:03,  1.08s/hosts]
FAIL |████████████████████████████████████████████████████████▎                  |  75% (3/4) [00:01<00:00,  2.77hosts/s]
75.0% (3/4) of nodes failed to execute command 'rm  -r /home/chandra-wmde/*': stat[1008-1009,1011].eqiad.wmnet
25.0% (1/4) success ratio (< 100.0% threshold) for command: 'rm  -r /home/chandra-wmde/*'. Aborting.: stat1010.eqiad.wmnet
25.0% (1/4) success ratio (< 100.0% threshold) of nodes successfully executed all commands. Aborting.: stat1010.eqiad.wmnet
brouberol@cumin1003:~$

Note: Go ahead for data deletion was from me - @AndrewTavis_WMDE :)