By default, pod logs are stored in k8s etcd or as part of the docker metadata. This is undesirable for a number of reasons. Figure out alternatives.
Description
Details
Status | Subtype | Assigned | Task | ||
---|---|---|---|---|---|
Resolved | • JHedden | T251027 "signatures" tool has failed job pods on Kubernetes cluster | |||
Resolved | aborrero | T251917 Design the Jobs service in k8s | |||
Resolved | aborrero | T283238 Toolforge: develop jobs-framework-api | |||
Open | None | T285944 Toolforge: beta phase for the new jobs framework | |||
Resolved | aborrero | T286485 toolforge-jobs: figure out logging |
Event Timeline
Change 704134 had a related patch set uploaded (by Arturo Borrero Gonzalez; author: Arturo Borrero Gonzalez):
[cloud/toolforge/jobs-framework-api@main] jobs: enforce job name to be friendly
Change 704135 had a related patch set uploaded (by Arturo Borrero Gonzalez; author: Arturo Borrero Gonzalez):
[cloud/toolforge/jobs-framework-api@main] job: force job stdout/stderr redirection to the each user home directory
Change 704134 merged by Arturo Borrero Gonzalez:
[cloud/toolforge/jobs-framework-api@main] jobs: enforce job name to be friendly
Change 704135 merged by Arturo Borrero Gonzalez:
[cloud/toolforge/jobs-framework-api@main] jobs: include option to log job stdout/stderr to the each user home directory
Change 704774 had a related patch set uploaded (by Arturo Borrero Gonzalez; author: Arturo Borrero Gonzalez):
[cloud/toolforge/jobs-framework-api@main] jobs: write to filelogs in append mode
Change 704775 had a related patch set uploaded (by Arturo Borrero Gonzalez; author: Arturo Borrero Gonzalez):
[cloud/toolforge/jobs-framework-cli@master] toolforge-jobs: add support new filelog option
Change 704774 merged by Arturo Borrero Gonzalez:
[cloud/toolforge/jobs-framework-api@main] jobs: write to filelogs in append mode
Change 704775 merged by Arturo Borrero Gonzalez:
[cloud/toolforge/jobs-framework-cli@master] toolforge-jobs: add support new filelog option
Mentioned in SAL (#wikimedia-cloud) [2021-07-15T16:12:12Z] <arturo> deploy toolforge-jobs-framework-api git version d85d93ee1c5d4be6a526cf83e806b2679dde3875 (T285944, T286107, T285979, T286485, T286107)