There are a bunch of files in /home on the old bastions (mostly on bastion-01.bastion.eqiad.wmflabs). In theory users shouldn't be storing things there anyway.
Now that I've changed DNS to point to eqiad1-r bastions, users won't be able to reach those files anymore. I'm not sure if we should just delete them and feel no remorse, or try to archive or salvage things somehow.
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T53494 Use Beta cluster as a true canary for code deployments (epic) | |||
| Open | None | T87220 Minimize infrastructure differences between Beta Cluster and production | |||
| Open | None | T196662 Set up LVS in beta like prod | |||
| Resolved | bd808 | T166396 Program 1 Outcome 4: VPS hosting | |||
| Resolved | None | T167293 Nova-network to Neutron migration | |||
| Resolved | Andrew | T204745 cloudvps: migrate projects from main to eqiad1 | |||
| Resolved | Andrew | T213085 Delete eqiad region bastion hosts | |||
| Resolved | Andrew | T213087 Stray user files on old eqiad bastions |
$ ssh bastion-01.bastion.eqiad.wmflabs $ find /home -type f|grep -v '/\.'|cut -d / -f 3|sort|uniq -c|sort -h 1 abdealijk 1 bflagg 1 brion 1 chicocvenancio 1 daniel 1 dcausse 1 deltaquad 1 dhun 1 milimetric 1 mschwarzer 1 mvolz 1 plato2000 1 southparkfan 1 stwalkerster 1 wmde-fisch 2 edsu 2 mobrovac 2 niedzielski 2 thehelpfulone 3 elvey 5 krenair 6 dr0ptp4kt 6 y-verciti 11 timmoody 22 jkbr 89 taxonbot 455 joedecker 551 fajne 788 diyop 5452 javad 11465 avgas 31174 tom29739
$ ssh bastion-02.bastion.eqiad.wmflabs $ find /home -type f|grep -v '/\.'|cut -d / -f 3|sort|uniq -c|sort -h $
$ ssh bastion-restricted-01.bastion.eqiad.wmflabs $ find /home -type f|grep -v '/\.'|cut -d / -f 3|sort|uniq -c|sort -h 7 andrew 23 ariel
$ ssh bastion-restricted-02.bastion.eqiad.wmflabs $ find /home -type f|grep -v '/\.'|cut -d / -f 3|sort|uniq -c|sort -h $
If we were doing this shuffle on a production network host we would probably rsync the files over to the new bastion. I'm kind of on the fence for this since as @Andrew said in the opening, in theory nobody should be doing work on the bastions.
I emailed most of the above users (everyone with more than ~50k of files) with notice that they have 7 days to do a rescue. A few people have followed up.