I discovered that /shared is not available within toolforge-jobs-initiated job:
tools.urbanecmbot@tools-sgebastion-10 ~ $ toolforge-jobs run test-sleep --command 'sleep 3600' --image=tf-python39 tools.urbanecmbot@tools-sgebastion-10 ~ $ toolforge-jobs list Job name: Job type: Status: ----------- ----------- --------- test-sleep normal Running tools.urbanecmbot@tools-sgebastion-10 ~ $ kubectl exec -it test-sleep-l7j8r -- bash tools.urbanecmbot@test-sleep-l7j8r:~$ ls /shared/pywikibot ls: cannot access '/shared/pywikibot': No such file or directory tools.urbanecmbot@test-sleep-l7j8r:~$ ls /shared ls: cannot access '/shared': No such file or directory tools.urbanecmbot@test-sleep-l7j8r:~$
/shared is usually a symbolic link to /data/project/.shared (on bastion/grid engine hosts). The target directory is normally available:
tools.urbanecmbot@test-sleep-l7j8r:~$ ls /data/project/.shared archive bin cache external-data media mediawiki node optimisations.diff page-dumps pagepile piagetbot pywikibot pywikipedia sqlqueries tabletop tcl tools.urbanecmbot@test-sleep-l7j8r:~$
I think the /shared shortcut should be created as well, as this is what users are used to from Toolforge's normal environment. Can we do that?