A couple examples:
- https://gitlab.wikimedia.org/repos/releng/docpub/-/jobs/297123
- https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-api/-/jobs/297121
The beginning of the problem seems to match GitLab 17 deployment today (T365675)
Description
Description
Details
Details
| Title | Reference | Author | Source Branch | Dest Branch | |
|---|---|---|---|---|---|
| reggie-values: fix URL deprecated in GitLab 17 | repos/releng/gitlab-cloud-runner!390 | jnuche | T368751 | main |
Related Objects
Related Objects
- Mentioned Here
- T365675: Upgrade GitLab to major version 17
Event Timeline
Comment Actions
jnuche opened https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/390
reggie-values: fix URL deprecated in GitLab 17
Comment Actions
thcipriani merged https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/390
reggie-values: fix URL deprecated in GitLab 17
Comment Actions
we were seeing this too https://gitlab.wikimedia.org/repos/data-engineering/mpic/-/jobs/297300 - just started happening
Comment Actions
Deployed what we think should be the fix.
For posterity, GitLab 17 removed the old jwt endpoint. For our registry (reggie) this comes from the environment variable REGGIE_JWKS_ENDPOINT. But this variable was set in both the reggie helm chart (where it was updated) and in our terraform (where it was not updated). We updated in terraform and I confirmed the DO CI cluster has the new value.
Let's retry some jobs.
Comment Actions
Success https://gitlab.wikimedia.org/repos/releng/docpub/-/jobs/297335
Retried a formerly failing job and it works, this should be fixed (I hope), reopen if that seems incorrect.