My jobs started to occasionally hang on toolforge. I've created an empty test job to see if it's my tool's fault and looks like it's a general toolforge issue.
My tool's name: chie-bot. I've created a test job job-test with the following configuration:
- name: job-test command: ./job-test image: bookworm schedule: "*/5 * * * *"
the contents of ./job-test:
date
So the only thing job does is outputs the current datetime and terminates. This has been working fine until Mon Nov 4 05:30:17 PM UTC 2024. Now toolforge jobs list is telling me this:
+-----------------------+------------------------+------------------------------------------+ | Job name: | Job type: | Status: | +-----------------------+------------------------+------------------------------------------+ | job-test | schedule: */5 * * * * | Running for 1d8h2m | +-----------------------+------------------------+------------------------------------------+
job-test.out file contains timetstamps as expected up until 05:30:17 PM. job-test.err is empty. Looking at Running for 1d8h2m suggests that the job failed to output the date in the last run.
T377420 is probably related
