Page MenuHomePhabricator
Paste P96542

Old temporary files in HDFS
ActivePublic
Actions

Authored by nshahquinn-wmf on Wed, Sep 30, 10:26 PM.
Project Tags
None
Referenced Files
F105608057: Old temporary files in HDFS
Wed, Sep 30, 10:26 PM
Subscribers
None
nshahquinn-wmf@stat1009:~$ sudo -u analytics-product kerberos-run-command analytics-product hdfs dfs -du -h
79.9 K .Trash
234.0 M .skein
1.3 M .sparkStaging
69.1 M .staging
13.5 M data
24 mysql-analytics-research-client-pw.txt
nshahquinn-wmf@stat1009:~$ sudo -u analytics-product kerberos-run-command analytics-product hdfs dfs -ls .skein
Found 170 items
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-14 00:01 .skein/application_1719935448343_1171215
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-14 00:01 .skein/application_1719935448343_1171216
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-14 00:00 .skein/application_1719935448343_1171217
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-14 00:00 .skein/application_1719935448343_1171218
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-14 00:01 .skein/application_1719935448343_1171219
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-14 00:01 .skein/application_1719935448343_1171221
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-14 00:01 .skein/application_1719935448343_1171222
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-14 00:01 .skein/application_1719935448343_1171226
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-14 00:01 .skein/application_1719935448343_1171227
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-14 00:01 .skein/application_1719935448343_1171228
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-14 00:01 .skein/application_1719935448343_1171242
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-17 00:00 .skein/application_1719935448343_1218340
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-17 00:00 .skein/application_1719935448343_1218341
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-17 00:00 .skein/application_1719935448343_1218342
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-17 00:00 .skein/application_1719935448343_1218343
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-17 00:00 .skein/application_1719935448343_1218344
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-17 00:00 .skein/application_1719935448343_1218345
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-17 00:01 .skein/application_1719935448343_1218346
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-17 00:00 .skein/application_1719935448343_1218347
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-17 00:01 .skein/application_1719935448343_1218350
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-17 00:04 .skein/application_1719935448343_1218493
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-18 00:00 .skein/application_1719935448343_1233970
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-18 00:00 .skein/application_1719935448343_1233971
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-18 00:00 .skein/application_1719935448343_1233972
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-18 00:00 .skein/application_1719935448343_1233973
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-18 00:00 .skein/application_1719935448343_1233974
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-18 00:00 .skein/application_1719935448343_1233975
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-18 00:00 .skein/application_1719935448343_1233977
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-18 00:00 .skein/application_1719935448343_1233978
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-18 00:00 .skein/application_1719935448343_1233979
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-18 00:00 .skein/application_1719935448343_1233980
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-18 00:03 .skein/application_1719935448343_1234094
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-19 00:00 .skein/application_1719935448343_1249794
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-19 00:00 .skein/application_1719935448343_1249795
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-19 00:00 .skein/application_1719935448343_1249796
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-19 00:00 .skein/application_1719935448343_1249797
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-19 00:00 .skein/application_1719935448343_1249798
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-19 00:00 .skein/application_1719935448343_1249799
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-19 00:00 .skein/application_1719935448343_1249800
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-19 00:00 .skein/application_1719935448343_1249801
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-19 00:00 .skein/application_1719935448343_1249802
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-19 00:00 .skein/application_1719935448343_1249803
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-19 00:00 .skein/application_1719935448343_1249804
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-19 00:01 .skein/application_1719935448343_1249805
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-19 00:01 .skein/application_1719935448343_1249806
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-20 00:00 .skein/application_1719935448343_1266034
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-20 14:04 .skein/application_1719935448343_1276510
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-21 00:00 .skein/application_1719935448343_1281791
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-21 00:00 .skein/application_1719935448343_1281792
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-21 00:00 .skein/application_1719935448343_1281793
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-21 00:00 .skein/application_1719935448343_1281794
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-21 00:00 .skein/application_1719935448343_1281795
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-21 00:00 .skein/application_1719935448343_1281796
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-21 00:00 .skein/application_1719935448343_1281797
drwxr-x--- - analytics-product analytics-privatedata-users 0 2024-09-21 00:01 .skein/application_1719935448343_1281798
drwxr-x--- - analytics-product analytics-privatedata-users 0 2024-09-21 00:01 .skein/application_1719935448343_1281801
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-21 00:04 .skein/application_1719935448343_1281911
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-22 00:01 .skein/application_1719935448343_1297523
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-22 00:00 .skein/application_1719935448343_1297524
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-22 00:00 .skein/application_1719935448343_1297525
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-22 00:00 .skein/application_1719935448343_1297526
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-22 00:00 .skein/application_1719935448343_1297527
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-22 00:00 .skein/application_1719935448343_1297528
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-22 00:00 .skein/application_1719935448343_1297529
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-22 00:01 .skein/application_1719935448343_1297530
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-23 00:00 .skein/application_1719935448343_1313287
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-24 00:00 .skein/application_1719935448343_1329001
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-24 00:00 .skein/application_1719935448343_1329002
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-24 00:00 .skein/application_1719935448343_1329003
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-24 00:00 .skein/application_1719935448343_1329004
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-24 00:00 .skein/application_1719935448343_1329005
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-24 00:00 .skein/application_1719935448343_1329006
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-24 00:00 .skein/application_1719935448343_1329007
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-24 00:00 .skein/application_1719935448343_1329008
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-24 00:00 .skein/application_1719935448343_1329009
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-24 00:00 .skein/application_1719935448343_1329010
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-24 00:00 .skein/application_1719935448343_1329011
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-24 00:01 .skein/application_1719935448343_1329012
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-24 00:00 .skein/application_1719935448343_1329013
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-24 00:01 .skein/application_1719935448343_1329014
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-25 00:00 .skein/application_1719935448343_1344779
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-27 00:00 .skein/application_1719935448343_1376365
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-27 00:00 .skein/application_1719935448343_1376366
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-27 00:00 .skein/application_1719935448343_1376367
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-27 00:00 .skein/application_1719935448343_1376368
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-27 00:00 .skein/application_1719935448343_1376369
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-27 00:00 .skein/application_1719935448343_1376370
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-27 00:00 .skein/application_1719935448343_1376372
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-27 00:00 .skein/application_1719935448343_1376373
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-27 00:00 .skein/application_1719935448343_1376374
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-27 00:00 .skein/application_1719935448343_1376375
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-27 00:00 .skein/application_1719935448343_1376376
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-27 00:00 .skein/application_1719935448343_1376377
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-27 00:00 .skein/application_1719935448343_1376378
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-27 00:01 .skein/application_1719935448343_1376379
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-27 00:01 .skein/application_1719935448343_1376380
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-29 00:00 .skein/application_1719935448343_1407936
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-29 00:00 .skein/application_1719935448343_1407937
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-29 00:00 .skein/application_1719935448343_1407938
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-29 00:00 .skein/application_1719935448343_1407939
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-29 00:00 .skein/application_1719935448343_1407940
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-29 00:00 .skein/application_1719935448343_1407941
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-29 00:00 .skein/application_1719935448343_1407942
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-29 00:00 .skein/application_1719935448343_1407943
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-29 00:01 .skein/application_1719935448343_1407944
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-29 00:01 .skein/application_1719935448343_1407945
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-29 00:01 .skein/application_1719935448343_1407946
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-29 00:04 .skein/application_1719935448343_1408071
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-30 00:00 .skein/application_1719935448343_1423861
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-30 00:01 .skein/application_1719935448343_1423862
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-30 00:00 .skein/application_1719935448343_1423863
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-30 00:00 .skein/application_1719935448343_1423864
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-30 00:00 .skein/application_1719935448343_1423865
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-30 00:00 .skein/application_1719935448343_1423866
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-30 00:00 .skein/application_1719935448343_1423867
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-30 00:00 .skein/application_1719935448343_1423868
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-30 00:00 .skein/application_1719935448343_1423869
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-30 00:00 .skein/application_1719935448343_1423870
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-30 00:00 .skein/application_1719935448343_1423871
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-30 00:00 .skein/application_1719935448343_1423872
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-30 00:00 .skein/application_1719935448343_1423873
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-30 00:00 .skein/application_1719935448343_1423874
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-30 00:00 .skein/application_1719935448343_1423875
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-30 00:01 .skein/application_1719935448343_1423876
drwxr-x--- - analytics-product analytics-privatedata-users 0 2024-09-30 00:01 .skein/application_1719935448343_1423877
drwx------ - analytics-product analytics-privatedata-users 0 2024-09-30 00:04 .skein/application_1719935448343_1424013
drwx------ - analytics-product analytics-privatedata-users 0 2024-10-01 00:00 .skein/application_1719935448343_1440745
drwx------ - analytics-product analytics-privatedata-users 0 2024-10-01 00:00 .skein/application_1719935448343_1440746
drwx------ - analytics-product analytics-privatedata-users 0 2024-10-01 00:00 .skein/application_1719935448343_1440747
drwx------ - analytics-product analytics-privatedata-users 0 2024-10-01 00:01 .skein/application_1719935448343_1440748
drwx------ - analytics-product analytics-privatedata-users 0 2024-10-01 00:01 .skein/application_1719935448343_1440749
drwx------ - analytics-product analytics-privatedata-users 0 2024-10-01 00:01 .skein/application_1719935448343_1440750
drwx------ - analytics-product analytics-privatedata-users 0 2024-10-01 00:01 .skein/application_1719935448343_1440751
drwx------ - analytics-product analytics-privatedata-users 0 2024-10-01 00:01 .skein/application_1719935448343_1440752
drwx------ - analytics-product analytics-privatedata-users 0 2024-10-01 00:01 .skein/application_1719935448343_1440753
drwx------ - analytics-product analytics-privatedata-users 0 2024-10-01 00:01 .skein/application_1719935448343_1440754
drwx------ - analytics-product analytics-privatedata-users 0 2024-10-01 00:01 .skein/application_1719935448343_1440755
drwx------ - analytics-product analytics-privatedata-users 0 2024-10-01 00:01 .skein/application_1719935448343_1440756
drwx------ - analytics-product analytics-privatedata-users 0 2024-10-01 00:01 .skein/application_1719935448343_1440757
drwx------ - analytics-product analytics-privatedata-users 0 2024-10-01 00:01 .skein/application_1719935448343_1440758
drwx------ - analytics-product analytics-privatedata-users 0 2024-10-01 00:01 .skein/application_1719935448343_1440759
drwx------ - analytics-product analytics-privatedata-users 0 2024-08-30 05:35 .skein/application_1719935448343_909843
drwx------ - analytics-product analytics-privatedata-users 0 2024-08-30 05:35 .skein/application_1719935448343_909844
drwx------ - analytics-product analytics-privatedata-users 0 2024-08-30 05:35 .skein/application_1719935448343_909845
drwx------ - analytics-product analytics-privatedata-users 0 2024-08-30 05:35 .skein/application_1719935448343_909846
drwx------ - analytics-product analytics-privatedata-users 0 2024-08-30 05:35 .skein/application_1719935448343_909847
drwx------ - analytics-product analytics-privatedata-users 0 2024-08-30 05:35 .skein/application_1719935448343_909848
drwx------ - analytics-product analytics-privatedata-users 0 2024-11-22 12:08 .skein/application_1727783536357_1011051
drwx------ - analytics-product analytics-privatedata-users 0 2024-10-22 05:06 .skein/application_1727783536357_374259
drwx------ - analytics-product analytics-privatedata-users 0 2024-11-02 12:03 .skein/application_1727783536357_553748
drwx------ - analytics-product analytics-privatedata-users 0 2024-12-03 22:01 .skein/application_1732360673415_367676
drwx------ - analytics-product analytics-privatedata-users 0 2025-02-18 17:05 .skein/application_1734703658237_1536661
drwx------ - analytics-product analytics-privatedata-users 0 2025-02-20 18:20 .skein/application_1734703658237_1568447
drwx------ - analytics-product analytics-privatedata-users 0 2025-02-20 22:00 .skein/application_1734703658237_1570612
drwx------ - analytics-product analytics-privatedata-users 0 2025-02-20 22:28 .skein/application_1734703658237_1570906
drwx------ - analytics-product analytics-privatedata-users 0 2025-02-20 23:00 .skein/application_1734703658237_1571233
drwx------ - analytics-product analytics-privatedata-users 0 2025-02-25 05:14 .skein/application_1734703658237_1679496
drwx------ - analytics-product analytics-privatedata-users 0 2025-02-27 18:05 .skein/application_1734703658237_1724849
drwx------ - analytics-product analytics-privatedata-users 0 2025-03-12 02:09 .skein/application_1734703658237_1994729
drwx------ - analytics-product analytics-privatedata-users 0 2025-04-04 06:06 .skein/application_1741864027385_484956
drwx------ - analytics-product analytics-privatedata-users 0 2025-04-11 09:19 .skein/application_1741864027385_621292
drwx------ - analytics-product analytics-privatedata-users 0 2025-04-11 17:36 .skein/application_1741864027385_629561
drwx------ - analytics-product analytics-privatedata-users 0 2025-04-11 18:31 .skein/application_1741864027385_630038
drwx------ - analytics-product analytics-privatedata-users 0 2025-04-14 01:16 .skein/application_1741864027385_670801
drwx------ - analytics-product analytics-privatedata-users 0 2025-04-15 21:20 .skein/application_1741864027385_705392
drwx------ - analytics-product analytics-privatedata-users 0 2026-03-05 10:47 .skein/application_1764064841637_2046453
drwx------ - analytics-product analytics-privatedata-users 0 2026-06-06 06:00 .skein/application_1778834239566_377005
drwx------ - analytics-product analytics-privatedata-users 0 2026-08-14 00:01 .skein/application_1786527810139_25876
drwx------ - analytics-product analytics-privatedata-users 0 2026-08-14 06:01 .skein/application_1786527810139_29592
drwx------ - analytics-product analytics-privatedata-users 0 2026-08-14 09:00 .skein/application_1786527810139_35144
nshahquinn-wmf@stat1009:~$ sudo -u analytics-product kerberos-run-command analytics-product hdfs dfs -ls .sparkStaging
Found 6 items
drwx------ - analytics-product analytics-privatedata-users 0 2025-06-18 00:15 .sparkStaging/application_1741864027385_2042474
drwx------ - analytics-product analytics-privatedata-users 0 2025-08-06 16:00 .sparkStaging/application_1750705250302_1359345
drwx------ - analytics-product analytics-privatedata-users 0 2026-02-02 20:00 .sparkStaging/application_1764064841637_1537920
drwx------ - analytics-product analytics-privatedata-users 0 2026-07-25 00:05 .sparkStaging/application_1778834239566_1285580
drwx------ - analytics-product analytics-privatedata-users 0 2026-09-03 00:04 .sparkStaging/application_1786527810139_466423
drwx------ - analytics-product analytics-privatedata-users 0 2026-09-22 10:09 .sparkStaging/application_1786527810139_883002
nshahquinn-wmf@stat1009:~$ sudo -u analytics-product kerberos-run-command analytics-product hdfs dfs -ls .staging
Found 3 items
drwx------ - analytics-product analytics-privatedata-users 0 2023-02-27 20:08 .staging/job_1676068183510_82936
drwx------ - analytics-product analytics-privatedata-users 0 2023-04-18 11:56 .staging/job_1678266962370_234808
drwx------ - analytics-product analytics-privatedata-users 0 2025-09-07 00:04 .staging/job_1754906949114_717626
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits