Page MenuHomePhabricator
Create Task
Maniphest T411235

Beta cluster scap using php8.1 container; php8.2 is now required
Closed, ResolvedPublicBUG REPORT
Actions

Description

From https://integration.wikimedia.org/ci/job/beta-scap-sync-world/234302/console

06:36:01 06:36:01 Error: You are using an unsupported PHP version (PHP 8.1.33).
06:36:01 MediaWiki 1.46 needs PHP 8.2.0 or higher.

Related Objects
Search...

Event Timeline

RhinosF1 created this task.Fri, Nov 28, 6:44 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFri, Nov 28, 6:44 AM
RhinosF1 mentioned this in T408275: 1.46.0-wmf.5 deployment blockers.Fri, Nov 28, 6:46 AM
RhinosF1 renamed this task from Beta cluster is running an unsupported version of PHP to Beta cluster CI is running an unsupported version of PHP.Fri, Nov 28, 6:50 AM
SomeRandomDeveloper subscribed.Fri, Nov 28, 1:46 PM
bd808 renamed this task from Beta cluster CI is running an unsupported version of PHP to Beta cluster scap using php8.1 container; php8.3 is now required.Fri, Nov 28, 4:13 PM
bd808 triaged this task as High priority.
bd808 changed the subtype of this task from "Task" to "Bug Report".
Stashbot added a comment.Fri, Nov 28, 4:38 PM

Mentioned in SAL (#wikimedia-releng) [2025-11-28T16:38:17Z] <bd808> Upgrading scap to 4.228.0 in beta cluster (T411235)

bd808 subscribed.Fri, Nov 28, 4:41 PM

I think we just need to update scap in deployment-prep. Let's try things from https://gitlab.wikimedia.org/repos/releng/scap/-/blob/master/RELEASE.md#beta-release

bd808@mbp03:~/projects/wmf/releng/scap$ ./release-scripts/scaps-installed-in-beta
10 hosts will be targeted:
deployment-deploy04.deployment-prep.eqiad1.wikimedia.cloud,deployment-echostore02.deployment-prep.eqiad1.wikimedia.cloud,deployment-jobrunner05.deployment-prep.eqiad1.wikimedia.cloud,deployment-mediawiki[13-14].deployment-prep.eqiad1.wikimedia.cloud,deployment-mwmaint03.deployment-prep.eqiad1.wikimedia.cloud,deployment-restbase05.deployment-prep.eqiad1.wikimedia.cloud,deployment-sessionstore06.deployment-prep.eqiad1.wikimedia.cloud,deployment-webperf[21-22].deployment-prep.eqiad1.wikimedia.cloud
FORCE mode enabled, continuing without confirmation
100.0% (10/10) success ratio (>= 100.0% threshold) for command: 'sudo -u scap scap version'.
100.0% (10/10) success ratio (>= 100.0% threshold) of nodes successfully executed all commands.
4.224.0
bd808@mbp03:~/projects/wmf/releng/scap$ ./release-scripts/update-scap-in-beta
No scap version specified!

Pick a scap version to deploy:
     1  4.228.0
     2  4.227.0
     3  4.226.0
     4  4.225.0
     5  4.224.0
Enter the number of the version above (empty or 0 to cancel) → 1

    Selected version '4.228.0'

Use this log message in #wikimedia-releng IRC:

    !log Upgrading scap to 4.228.0 in beta cluster

Press enter to deploy (Ctrl-C to cancel)

Already on 'master'
Your branch is up to date with 'origin/master'.
From https://gitlab.wikimedia.org/repos/releng/scap
 * branch            master     -> FETCH_HEAD
Updating 11ec8cd..7be480d
Fast-forward
 changelog                               |   30 +-
 requirements.txt                        |    2 +
 scap/backport.py                        |  146 ++-
 scap/cli.py                             |   14 +-
 scap/config.py                          |    2 +-
 scap/git.py                             |    8 +-
 scap/kubernetes.py                      |   20 +-
 scap/patches.py                         |  389 ++++--
 scap/spiderpig/api.py                   |   21 +-
 scap/updateinterwikicache.py            |    2 +-
 scap/version.py                         |    2 +-
 tests/scap/integration/test_backport.py |   47 +-
 tests/scap/test_backport.py             |  543 +++++----
 tests/scap/test_patches.py              | 1961 +++++++++++++++++++++++++++++++
 tests/scap/test_utils.py                |    4 +-
 web/src/api.js                          |   22 +-
 16 files changed, 2778 insertions(+), 435 deletions(-)
 create mode 100644 tests/scap/test_patches.py
   11ec8cd..7be480d  master     -> origin/master
INFO: Scap version "4.228.0" for distribution "bullseye" successfully extracted at /var/lib/scap/scap-wheels/bullseye/4.228.0
INFO: Scap version "4.228.0" for distribution "bookworm" successfully extracted at /var/lib/scap/scap-wheels/bookworm/4.228.0
INFO: Deleted old wheels at "/var/lib/scap/scap-wheels/bullseye/4.211.0"
INFO: Deleted old wheels at "/var/lib/scap/scap-wheels/bookworm/4.211.0"
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pip-25.3-py3-none-any.whl
Installing collected packages: pip
  Attempting uninstall: pip
    Found existing installation: pip 20.3.4
    Uninstalling pip-20.3.4:
      Successfully uninstalled pip-20.3.4
Successfully installed pip-25.3
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/MarkupSafe-3.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/PyJWT-2.10.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/PyYAML-6.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/SQLAlchemy-2.0.32-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/alembic-1.16.5-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/annotated_types-0.7.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/anyio-4.11.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/certifi-2024.7.4-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/chardet-5.2.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/charset_normalizer-2.1.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/click-8.1.8-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/dnspython-2.7.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/email_validator-2.3.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/exceptiongroup-1.3.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/fastapi-0.116.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/fastapi_cli-0.0.16-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/fastapi_cloud_cli-0.5.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/fastar-0.6.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/greenlet-3.0.3-cp39-cp39-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/h11-0.16.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/httpcore-1.0.9-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/httptools-0.7.1-cp39-cp39-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/httpx-0.28.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/idna-3.7-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/importlib_resources-6.5.2-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/itsdangerous-2.2.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/jinja2-3.1.6-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/lxml-6.0.2-cp39-cp39-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/mako-1.3.10-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/markdown_it_py-3.0.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/mdurl-0.1.2-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/packaging-25.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pip-25.3-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/prettytable-3.7.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pydantic-2.10.6-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pydantic_core-2.27.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pygments-2.17.2-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pyotp-2.9.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pyparsing-3.0.9-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/python_cas-1.6.0-py2.py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/python_dotenv-1.2.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/python_multipart-0.0.20-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/requests-2.32.4-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/rich-14.2.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/rich_toolkit-0.16.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/rignore-0.7.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/scap-4.228.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/sentry_sdk-2.45.0-py2.py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/setuptools-78.1.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/shellingham-1.5.4-py2.py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/six-1.17.0-py2.py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/sniffio-1.3.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/starlette-0.47.2-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/tomli-2.3.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/typer-0.20.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/typing_extensions-4.15.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/urllib3-2.5.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/uvicorn-0.38.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/uvloop-0.22.1-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/watchfiles-1.1.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/wcwidth-0.2.5-py2.py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/websockets-15.0.1-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/zipp-3.23.0-py3-none-any.whl
pip is already installed with the same version as the provided wheel. Use --force-reinstall to force an installation of the wheel.
Installing collected packages: wcwidth, zipp, websockets, watchfiles, uvloop, uvicorn, urllib3, typing-extensions, typer, tomli, starlette, sqlalchemy, sniffio, six, shellingham, setuptools, sentry-sdk, scap, rignore, rich-toolkit, rich, requests, pyyaml, python-multipart, python-dotenv, python-cas, pyparsing, pyotp, pyjwt, pygments, pydantic-core, pydantic, prettytable, packaging, mdurl, markupsafe, markdown-it-py, mako, lxml, jinja2, itsdangerous, importlib-resources, idna, httpx, httptools, httpcore, h11, greenlet, fastar, fastapi-cloud-cli, fastapi-cli, fastapi, exceptiongroup, email-validator, dnspython, click, charset-normalizer, chardet, certifi, anyio, annotated-types, alembic
  Attempting uninstall: setuptools
    Found existing installation: setuptools 44.1.1
    Uninstalling setuptools-44.1.1:
      Successfully uninstalled setuptools-44.1.1

Successfully installed alembic-1.16.5 annotated-types-0.7.0 anyio-4.11.0 certifi-2024.7.4 chardet-5.2.0 charset-normalizer-2.1.1 click-8.1.8 dnspython-2.7.0 email-validator-2.3.0 exceptiongroup-1.3.0 fastapi-0.116.1 fastapi-cli-0.0.16 fastapi-cloud-cli-0.5.1 fastar-0.6.0 greenlet-3.0.3 h11-0.16.0 httpcore-1.0.9 httptools-0.7.1 httpx-0.28.1 idna-3.7 importlib-resources-6.5.2 itsdangerous-2.2.0 jinja2-3.1.6 lxml-6.0.2 mako-1.3.10 markdown-it-py-3.0.0 markupsafe-3.0.2 mdurl-0.1.2 packaging-25.0 prettytable-3.7.0 pydantic-2.10.6 pydantic-core-2.27.2 pygments-2.17.2 pyjwt-2.10.1 pyotp-2.9.0 pyparsing-3.0.9 python-cas-1.6.0 python-dotenv-1.2.1 python-multipart-0.0.20 pyyaml-6.0.2 requests-2.32.4 rich-14.2.0 rich-toolkit-0.16.0 rignore-0.7.6 scap-4.228.0 sentry-sdk-2.45.0 setuptools-78.1.1 shellingham-1.5.4 six-1.17.0 sniffio-1.3.1 sqlalchemy-2.0.32 starlette-0.47.2 tomli-2.3.0 typer-0.20.0 typing-extensions-4.15.0 urllib3-2.5.0 uvicorn-0.38.0 uvloop-0.22.1 watchfiles-1.1.1 wcwidth-0.2.5 websockets-15.0.1 zipp-3.23.0

INFO: Scap "4.228.0" for "bullseye" successfully installed at /var/lib/scap/scap
16:38:52 Installing scap version "4.228.0" for 10 host(s)
16:38:52 Installing version "4.228.0" locally
INFO: Scap version "4.228.0" for distribution "bullseye" already exists locally. Nothing to retrieve
INFO: Scap version "4.228.0" for distribution "bookworm" already exists locally. Nothing to retrieve
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pip-25.3-py3-none-any.whl
Installing collected packages: pip
  Attempting uninstall: pip
    Found existing installation: pip 20.3.4
    Uninstalling pip-20.3.4:
      Successfully uninstalled pip-20.3.4
Successfully installed pip-25.3
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/MarkupSafe-3.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/PyJWT-2.10.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/PyYAML-6.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/SQLAlchemy-2.0.32-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/alembic-1.16.5-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/annotated_types-0.7.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/anyio-4.11.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/certifi-2024.7.4-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/chardet-5.2.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/charset_normalizer-2.1.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/click-8.1.8-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/dnspython-2.7.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/email_validator-2.3.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/exceptiongroup-1.3.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/fastapi-0.116.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/fastapi_cli-0.0.16-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/fastapi_cloud_cli-0.5.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/fastar-0.6.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/greenlet-3.0.3-cp39-cp39-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/h11-0.16.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/httpcore-1.0.9-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/httptools-0.7.1-cp39-cp39-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/httpx-0.28.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/idna-3.7-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/importlib_resources-6.5.2-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/itsdangerous-2.2.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/jinja2-3.1.6-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/lxml-6.0.2-cp39-cp39-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/mako-1.3.10-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/markdown_it_py-3.0.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/mdurl-0.1.2-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/packaging-25.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pip-25.3-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/prettytable-3.7.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pydantic-2.10.6-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pydantic_core-2.27.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pygments-2.17.2-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pyotp-2.9.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pyparsing-3.0.9-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/python_cas-1.6.0-py2.py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/python_dotenv-1.2.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/python_multipart-0.0.20-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/requests-2.32.4-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/rich-14.2.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/rich_toolkit-0.16.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/rignore-0.7.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/scap-4.228.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/sentry_sdk-2.45.0-py2.py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/setuptools-78.1.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/shellingham-1.5.4-py2.py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/six-1.17.0-py2.py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/sniffio-1.3.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/starlette-0.47.2-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/tomli-2.3.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/typer-0.20.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/typing_extensions-4.15.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/urllib3-2.5.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/uvicorn-0.38.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/uvloop-0.22.1-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/watchfiles-1.1.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/wcwidth-0.2.5-py2.py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/websockets-15.0.1-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/zipp-3.23.0-py3-none-any.whl
pip is already installed with the same version as the provided wheel. Use --force-reinstall to force an installation of the wheel.
Installing collected packages: wcwidth, zipp, websockets, watchfiles, uvloop, uvicorn, urllib3, typing-extensions, typer, tomli, starlette, sqlalchemy, sniffio, six, shellingham, setuptools, sentry-sdk, scap, rignore, rich-toolkit, rich, requests, pyyaml, python-multipart, python-dotenv, python-cas, pyparsing, pyotp, pyjwt, pygments, pydantic-core, pydantic, prettytable, packaging, mdurl, markupsafe, markdown-it-py, mako, lxml, jinja2, itsdangerous, importlib-resources, idna, httpx, httptools, httpcore, h11, greenlet, fastar, fastapi-cloud-cli, fastapi-cli, fastapi, exceptiongroup, email-validator, dnspython, click, charset-normalizer, chardet, certifi, anyio, annotated-types, alembic
  Attempting uninstall: setuptools
    Found existing installation: setuptools 44.1.1
    Uninstalling setuptools-44.1.1:
      Successfully uninstalled setuptools-44.1.1

Successfully installed alembic-1.16.5 annotated-types-0.7.0 anyio-4.11.0 certifi-2024.7.4 chardet-5.2.0 charset-normalizer-2.1.1 click-8.1.8 dnspython-2.7.0 email-validator-2.3.0 exceptiongroup-1.3.0 fastapi-0.116.1 fastapi-cli-0.0.16 fastapi-cloud-cli-0.5.1 fastar-0.6.0 greenlet-3.0.3 h11-0.16.0 httpcore-1.0.9 httptools-0.7.1 httpx-0.28.1 idna-3.7 importlib-resources-6.5.2 itsdangerous-2.2.0 jinja2-3.1.6 lxml-6.0.2 mako-1.3.10 markdown-it-py-3.0.0 markupsafe-3.0.2 mdurl-0.1.2 packaging-25.0 prettytable-3.7.0 pydantic-2.10.6 pydantic-core-2.27.2 pygments-2.17.2 pyjwt-2.10.1 pyotp-2.9.0 pyparsing-3.0.9 python-cas-1.6.0 python-dotenv-1.2.1 python-multipart-0.0.20 pyyaml-6.0.2 requests-2.32.4 rich-14.2.0 rich-toolkit-0.16.0 rignore-0.7.6 scap-4.228.0 sentry-sdk-2.45.0 setuptools-78.1.1 shellingham-1.5.4 six-1.17.0 sniffio-1.3.1 sqlalchemy-2.0.32 starlette-0.47.2 tomli-2.3.0 typer-0.20.0 typing-extensions-4.15.0 urllib3-2.5.0 uvicorn-0.38.0 uvloop-0.22.1 watchfiles-1.1.1 wcwidth-0.2.5 websockets-15.0.1 zipp-3.23.0

INFO: Scap "4.228.0" for "bullseye" successfully installed at /var/lib/scap/scap
16:39:04 Syncing installation material to 9 scap targets from "deployment-deploy04.deployment-prep.eqiad1.wikimedia.cloud"
16:39:04 scap-sync-wheels-to-targets:   0% (ok: 0; fail: 0; left: 9)
16:39:04 ['/usr/bin/rsync', '--archive', '--compress', '--new-compress', '--delay-updates', '--delete', '--delete-delay', 'deployment-deploy04.deployment-prep.eqiad1.wikimedia.cloud::scap-install-staging/scap-wheels/$(lsb_release -cs)/4.228.0/', '/var/lib/scap/$(lsb_release -cs)'] (ran as scap@deployment-restbase05.deployment-prep.eqiad1.wikimedia.cloud) returned [255]: Load key "/etc/keyholder.d/scap.pub": invalid format
scap@deployment-restbase05.deployment-prep.eqiad1.wikimedia.cloud: Permission denied (publickey).

16:39:04 ['/usr/bin/rsync', '--archive', '--compress', '--new-compress', '--delay-updates', '--delete', '--delete-delay', 'deployment-deploy04.deployment-prep.eqiad1.wikimedia.cloud::scap-install-staging/scap-wheels/$(lsb_release -cs)/4.228.0/', '/var/lib/scap/$(lsb_release -cs)'] (ran as scap@deployment-mediawiki14.deployment-prep.eqiad1.wikimedia.cloud) returned [255]: Load key "/etc/keyholder.d/scap.pub": invalid format
scap@deployment-mediawiki14.deployment-prep.eqiad1.wikimedia.cloud: Permission denied (publickey).

16:39:04 ['/usr/bin/rsync', '--archive', '--compress', '--new-compress', '--delay-updates', '--delete', '--delete-delay', 'deployment-deploy04.deployment-prep.eqiad1.wikimedia.cloud::scap-install-staging/scap-wheels/$(lsb_release -cs)/4.228.0/', '/var/lib/scap/$(lsb_release -cs)'] (ran as scap@deployment-echostore02.deployment-prep.eqiad1.wikimedia.cloud) returned [255]: Load key "/etc/keyholder.d/scap.pub": invalid format
scap@deployment-echostore02.deployment-prep.eqiad1.wikimedia.cloud: Permission denied (publickey).

16:39:04 ['/usr/bin/rsync', '--archive', '--compress', '--new-compress', '--delay-updates', '--delete', '--delete-delay', 'deployment-deploy04.deployment-prep.eqiad1.wikimedia.cloud::scap-install-staging/scap-wheels/$(lsb_release -cs)/4.228.0/', '/var/lib/scap/$(lsb_release -cs)'] (ran as scap@deployment-mediawiki13.deployment-prep.eqiad1.wikimedia.cloud) returned [255]: Load key "/etc/keyholder.d/scap.pub": invalid format
scap@deployment-mediawiki13.deployment-prep.eqiad1.wikimedia.cloud: Permission denied (publickey).

16:39:04 ['/usr/bin/rsync', '--archive', '--compress', '--new-compress', '--delay-updates', '--delete', '--delete-delay', 'deployment-deploy04.deployment-prep.eqiad1.wikimedia.cloud::scap-install-staging/scap-wheels/$(lsb_release -cs)/4.228.0/', '/var/lib/scap/$(lsb_release -cs)'] (ran as scap@deployment-webperf21.deployment-prep.eqiad1.wikimedia.cloud) returned [255]: Load key "/etc/keyholder.d/scap.pub": invalid format
scap@deployment-webperf21.deployment-prep.eqiad1.wikimedia.cloud: Permission denied (publickey).

16:39:04 ['/usr/bin/rsync', '--archive', '--compress', '--new-compress', '--delay-updates', '--delete', '--delete-delay', 'deployment-deploy04.deployment-prep.eqiad1.wikimedia.cloud::scap-install-staging/scap-wheels/$(lsb_release -cs)/4.228.0/', '/var/lib/scap/$(lsb_release -cs)'] (ran as scap@deployment-webperf22.deployment-prep.eqiad1.wikimedia.cloud) returned [255]: Load key "/etc/keyholder.d/scap.pub": invalid format
scap@deployment-webperf22.deployment-prep.eqiad1.wikimedia.cloud: Permission denied (publickey).

16:39:04 ['/usr/bin/rsync', '--archive', '--compress', '--new-compress', '--delay-updates', '--delete', '--delete-delay', 'deployment-deploy04.deployment-prep.eqiad1.wikimedia.cloud::scap-install-staging/scap-wheels/$(lsb_release -cs)/4.228.0/', '/var/lib/scap/$(lsb_release -cs)'] (ran as scap@deployment-jobrunner05.deployment-prep.eqiad1.wikimedia.cloud) returned [255]: Load key "/etc/keyholder.d/scap.pub": invalid format
scap@deployment-jobrunner05.deployment-prep.eqiad1.wikimedia.cloud: Permission denied (publickey).

16:39:04 ['/usr/bin/rsync', '--archive', '--compress', '--new-compress', '--delay-updates', '--delete', '--delete-delay', 'deployment-deploy04.deployment-prep.eqiad1.wikimedia.cloud::scap-install-staging/scap-wheels/$(lsb_release -cs)/4.228.0/', '/var/lib/scap/$(lsb_release -cs)'] (ran as scap@deployment-mwmaint03.deployment-prep.eqiad1.wikimedia.cloud) returned [255]: Load key "/etc/keyholder.d/scap.pub": invalid format
scap@deployment-mwmaint03.deployment-prep.eqiad1.wikimedia.cloud: Permission denied (publickey).

16:39:04 ['/usr/bin/rsync', '--archive', '--compress', '--new-compress', '--delay-updates', '--delete', '--delete-delay', 'deployment-deploy04.deployment-prep.eqiad1.wikimedia.cloud::scap-install-staging/scap-wheels/$(lsb_release -cs)/4.228.0/', '/var/lib/scap/$(lsb_release -cs)'] (ran as scap@deployment-sessionstore06.deployment-prep.eqiad1.wikimedia.cloud) returned [255]: Load key "/etc/keyholder.d/scap.pub": invalid format
scap@deployment-sessionstore06.deployment-prep.eqiad1.wikimedia.cloud: Permission denied (publickey).

16:39:04 9 targets failed to sync scap installation material
16:39:04 scap-sync-wheels-to-targets: 100% (in-flight: 0; ok: 0; fail: 9; left: 0)
Aborting: Install failed

It looks like we get a side trip into figuring out what's up with keyholder:

16:39:04 ['/usr/bin/rsync', '--archive', '--compress', '--new-compress', '--delay-updates', '--delete', '--delete-delay', 'deployment-deploy04.deployment-prep.eqiad1.wikimedia.cloud::scap-install-staging/scap-wheels/$(lsb_release -cs)/4.228.0/', '/var/lib/scap/$(lsb_release -cs)'] (ran as scap@deployment-restbase05.deployment-prep.eqiad1.wikimedia.cloud) returned [255]: Load key "/etc/keyholder.d/scap.pub": invalid format
scap@deployment-restbase05.deployment-prep.eqiad1.wikimedia.cloud: Permission denied (publickey).
bd808 added a comment.Fri, Nov 28, 4:49 PM
bd808@deployment-deploy04:/srv/mediawiki-staging$ sudo keyholder status
keyholder-agent: active
- The agent has no identities.
keyholder-proxy: active
- The agent has no identities.

https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/Help#Secrets

bd808@deployment-deploy04:/srv/mediawiki-staging$ sudo keyholder arm
/etc/keyholder.d/phabricator is not an acceptable key. Is it an RSA or ED25519 key with passphrase?
Enter passphrase for /etc/keyholder.d/analytics_deploy: 
Identity added: /etc/keyholder.d/analytics_deploy (/etc/keyholder.d/analytics_deploy)
Enter passphrase for /etc/keyholder.d/deploy_service:
Identity added: /etc/keyholder.d/deploy_service (/etc/keyholder.d/deploy_service)
Enter passphrase for /etc/keyholder.d/dumpsdeploy:
Identity added: /etc/keyholder.d/dumpsdeploy (/etc/keyholder.d/dumpsdeploy)
Enter passphrase for /etc/keyholder.d/mwdeploy:
Identity added: /etc/keyholder.d/mwdeploy (/etc/keyholder.d/mwdeploy)
Enter passphrase for /etc/keyholder.d/scap:
Identity added: /etc/keyholder.d/scap (/etc/keyholder.d/scap)
bd808@deployment-deploy04:/srv/mediawiki-staging$ sudo keyholder status
keyholder-agent: active
- 4096 SHA256:mTAVt5HHOBoHajbrl02TW9HZM5W68zYIZSNTbsK0m0Q /etc/keyholder.d/analytics_deploy (RSA)
- 4096 SHA256:r1lnGAlHtsvjaAl4JeqdnxCGEygMFDU1hf3tWZ8vHgU /etc/keyholder.d/deploy_service (RSA)
- 4096 SHA256:MjqJXMZbB6uki4G9LuVVgEogog9Z/nwntDZwZSjn+fs /etc/keyholder.d/dumpsdeploy (RSA)
- 2048 SHA256:nUV3qf86EbG/cslV8H2DkV2upw8CGoIgqYYH2UPK7QE /etc/keyholder.d/mwdeploy (RSA)
- 256 SHA256:mbI0ELyh+jn9O2h0RPd3b56T5skD92kyYz/osf4sn5c /etc/keyholder.d/scap (ED25519)
keyholder-proxy: active
- 4096 SHA256:mTAVt5HHOBoHajbrl02TW9HZM5W68zYIZSNTbsK0m0Q /etc/keyholder.d/analytics_deploy (RSA)
- 4096 SHA256:r1lnGAlHtsvjaAl4JeqdnxCGEygMFDU1hf3tWZ8vHgU /etc/keyholder.d/deploy_service (RSA)
- 4096 SHA256:MjqJXMZbB6uki4G9LuVVgEogog9Z/nwntDZwZSjn+fs /etc/keyholder.d/dumpsdeploy (RSA)
- 2048 SHA256:nUV3qf86EbG/cslV8H2DkV2upw8CGoIgqYYH2UPK7QE /etc/keyholder.d/mwdeploy (RSA)
- 256 SHA256:mbI0ELyh+jn9O2h0RPd3b56T5skD92kyYz/osf4sn5c /etc/keyholder.d/scap (ED25519)

That was annoying. I really should work on T388695: Consider removing passphrases from deployment-prep's ssh keys used by `keyholder`.

Stashbot added a comment.Fri, Nov 28, 4:50 PM

Mentioned in SAL (#wikimedia-releng) [2025-11-28T16:50:40Z] <bd808> Upgrading scap to 4.228.0 in beta cluster [take 2] (T411235)

bd808 added a comment.Fri, Nov 28, 4:53 PM
bd808@mbp03:~/projects/wmf/releng/scap$ ./release-scripts/update-scap-in-beta
No scap version specified!

Pick a scap version to deploy:
     1  4.228.0
     2  4.227.0
     3  4.226.0
     4  4.225.0
     5  4.224.0
Enter the number of the version above (empty or 0 to cancel) → 1

    Selected version '4.228.0'

Use this log message in #wikimedia-releng IRC:

    !log Upgrading scap to 4.228.0 in beta cluster

Press enter to deploy (Ctrl-C to cancel)

Your branch is up to date with 'origin/master'.
Already on 'master'
From https://gitlab.wikimedia.org/repos/releng/scap
 * branch            master     -> FETCH_HEAD
Already up to date.
INFO: Scap version "4.228.0" for distribution "bullseye" already exists locally. Nothing to retrieve
INFO: Scap version "4.228.0" for distribution "bookworm" already exists locally. Nothing to retrieve
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pip-25.3-py3-none-any.whl
Installing collected packages: pip
  Attempting uninstall: pip
    Found existing installation: pip 20.3.4
    Uninstalling pip-20.3.4:
      Successfully uninstalled pip-20.3.4
Successfully installed pip-25.3
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/MarkupSafe-3.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/PyJWT-2.10.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/PyYAML-6.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/SQLAlchemy-2.0.32-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/alembic-1.16.5-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/annotated_types-0.7.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/anyio-4.11.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/certifi-2024.7.4-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/chardet-5.2.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/charset_normalizer-2.1.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/click-8.1.8-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/dnspython-2.7.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/email_validator-2.3.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/exceptiongroup-1.3.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/fastapi-0.116.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/fastapi_cli-0.0.16-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/fastapi_cloud_cli-0.5.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/fastar-0.6.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/greenlet-3.0.3-cp39-cp39-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/h11-0.16.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/httpcore-1.0.9-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/httptools-0.7.1-cp39-cp39-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/httpx-0.28.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/idna-3.7-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/importlib_resources-6.5.2-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/itsdangerous-2.2.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/jinja2-3.1.6-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/lxml-6.0.2-cp39-cp39-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/mako-1.3.10-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/markdown_it_py-3.0.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/mdurl-0.1.2-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/packaging-25.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pip-25.3-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/prettytable-3.7.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pydantic-2.10.6-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pydantic_core-2.27.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pygments-2.17.2-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pyotp-2.9.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pyparsing-3.0.9-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/python_cas-1.6.0-py2.py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/python_dotenv-1.2.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/python_multipart-0.0.20-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/requests-2.32.4-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/rich-14.2.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/rich_toolkit-0.16.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/rignore-0.7.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/scap-4.228.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/sentry_sdk-2.45.0-py2.py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/setuptools-78.1.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/shellingham-1.5.4-py2.py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/six-1.17.0-py2.py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/sniffio-1.3.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/starlette-0.47.2-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/tomli-2.3.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/typer-0.20.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/typing_extensions-4.15.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/urllib3-2.5.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/uvicorn-0.38.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/uvloop-0.22.1-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/watchfiles-1.1.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/wcwidth-0.2.5-py2.py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/websockets-15.0.1-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/zipp-3.23.0-py3-none-any.whl
pip is already installed with the same version as the provided wheel. Use --force-reinstall to force an installation of the wheel.
Installing collected packages: wcwidth, zipp, websockets, watchfiles, uvloop, uvicorn, urllib3, typing-extensions, typer, tomli, starlette, sqlalchemy, sniffio, six, shellingham, setuptools, sentry-sdk, scap, rignore, rich-toolkit, rich, requests, pyyaml, python-multipart, python-dotenv, python-cas, pyparsing, pyotp, pyjwt, pygments, pydantic-core, pydantic, prettytable, packaging, mdurl, markupsafe, markdown-it-py, mako, lxml, jinja2, itsdangerous, importlib-resources, idna, httpx, httptools, httpcore, h11, greenlet, fastar, fastapi-cloud-cli, fastapi-cli, fastapi, exceptiongroup, email-validator, dnspython, click, charset-normalizer, chardet, certifi, anyio, annotated-types, alembic
  Attempting uninstall: setuptools
    Found existing installation: setuptools 44.1.1
    Uninstalling setuptools-44.1.1:
      Successfully uninstalled setuptools-44.1.1

Successfully installed alembic-1.16.5 annotated-types-0.7.0 anyio-4.11.0 certifi-2024.7.4 chardet-5.2.0 charset-normalizer-2.1.1 click-8.1.8 dnspython-2.7.0 email-validator-2.3.0 exceptiongroup-1.3.0 fastapi-0.116.1 fastapi-cli-0.0.16 fastapi-cloud-cli-0.5.1 fastar-0.6.0 greenlet-3.0.3 h11-0.16.0 httpcore-1.0.9 httptools-0.7.1 httpx-0.28.1 idna-3.7 importlib-resources-6.5.2 itsdangerous-2.2.0 jinja2-3.1.6 lxml-6.0.2 mako-1.3.10 markdown-it-py-3.0.0 markupsafe-3.0.2 mdurl-0.1.2 packaging-25.0 prettytable-3.7.0 pydantic-2.10.6 pydantic-core-2.27.2 pygments-2.17.2 pyjwt-2.10.1 pyotp-2.9.0 pyparsing-3.0.9 python-cas-1.6.0 python-dotenv-1.2.1 python-multipart-0.0.20 pyyaml-6.0.2 requests-2.32.4 rich-14.2.0 rich-toolkit-0.16.0 rignore-0.7.6 scap-4.228.0 sentry-sdk-2.45.0 setuptools-78.1.1 shellingham-1.5.4 six-1.17.0 sniffio-1.3.1 sqlalchemy-2.0.32 starlette-0.47.2 tomli-2.3.0 typer-0.20.0 typing-extensions-4.15.0 urllib3-2.5.0 uvicorn-0.38.0 uvloop-0.22.1 watchfiles-1.1.1 wcwidth-0.2.5 websockets-15.0.1 zipp-3.23.0

INFO: Scap "4.228.0" for "bullseye" successfully installed at /var/lib/scap/scap
16:50:57 Installing scap version "4.228.0" for 10 host(s)
16:50:57 Installing version "4.228.0" locally
INFO: Scap version "4.228.0" for distribution "bullseye" already exists locally. Nothing to retrieve
INFO: Scap version "4.228.0" for distribution "bookworm" already exists locally. Nothing to retrieve
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pip-25.3-py3-none-any.whl
Installing collected packages: pip
  Attempting uninstall: pip
    Found existing installation: pip 20.3.4
    Uninstalling pip-20.3.4:
      Successfully uninstalled pip-20.3.4
Successfully installed pip-25.3
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/MarkupSafe-3.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/PyJWT-2.10.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/PyYAML-6.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/SQLAlchemy-2.0.32-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/alembic-1.16.5-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/annotated_types-0.7.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/anyio-4.11.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/certifi-2024.7.4-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/chardet-5.2.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/charset_normalizer-2.1.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/click-8.1.8-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/dnspython-2.7.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/email_validator-2.3.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/exceptiongroup-1.3.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/fastapi-0.116.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/fastapi_cli-0.0.16-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/fastapi_cloud_cli-0.5.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/fastar-0.6.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/greenlet-3.0.3-cp39-cp39-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/h11-0.16.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/httpcore-1.0.9-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/httptools-0.7.1-cp39-cp39-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/httpx-0.28.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/idna-3.7-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/importlib_resources-6.5.2-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/itsdangerous-2.2.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/jinja2-3.1.6-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/lxml-6.0.2-cp39-cp39-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/mako-1.3.10-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/markdown_it_py-3.0.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/mdurl-0.1.2-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/packaging-25.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pip-25.3-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/prettytable-3.7.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pydantic-2.10.6-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pydantic_core-2.27.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pygments-2.17.2-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pyotp-2.9.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/pyparsing-3.0.9-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/python_cas-1.6.0-py2.py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/python_dotenv-1.2.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/python_multipart-0.0.20-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/requests-2.32.4-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/rich-14.2.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/rich_toolkit-0.16.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/rignore-0.7.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/scap-4.228.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/sentry_sdk-2.45.0-py2.py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/setuptools-78.1.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/shellingham-1.5.4-py2.py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/six-1.17.0-py2.py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/sniffio-1.3.1-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/starlette-0.47.2-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/tomli-2.3.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/typer-0.20.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/typing_extensions-4.15.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/urllib3-2.5.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/uvicorn-0.38.0-py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/uvloop-0.22.1-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/watchfiles-1.1.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/wcwidth-0.2.5-py2.py3-none-any.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/websockets-15.0.1-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /var/lib/scap/scap-wheels/bullseye/4.228.0/zipp-3.23.0-py3-none-any.whl
pip is already installed with the same version as the provided wheel. Use --force-reinstall to force an installation of the wheel.
Installing collected packages: wcwidth, zipp, websockets, watchfiles, uvloop, uvicorn, urllib3, typing-extensions, typer, tomli, starlette, sqlalchemy, sniffio, six, shellingham, setuptools, sentry-sdk, scap, rignore, rich-toolkit, rich, requests, pyyaml, python-multipart, python-dotenv, python-cas, pyparsing, pyotp, pyjwt, pygments, pydantic-core, pydantic, prettytable, packaging, mdurl, markupsafe, markdown-it-py, mako, lxml, jinja2, itsdangerous, importlib-resources, idna, httpx, httptools, httpcore, h11, greenlet, fastar, fastapi-cloud-cli, fastapi-cli, fastapi, exceptiongroup, email-validator, dnspython, click, charset-normalizer, chardet, certifi, anyio, annotated-types, alembic
  Attempting uninstall: setuptools
    Found existing installation: setuptools 44.1.1
    Uninstalling setuptools-44.1.1:
      Successfully uninstalled setuptools-44.1.1

Successfully installed alembic-1.16.5 annotated-types-0.7.0 anyio-4.11.0 certifi-2024.7.4 chardet-5.2.0 charset-normalizer-2.1.1 click-8.1.8 dnspython-2.7.0 email-validator-2.3.0 exceptiongroup-1.3.0 fastapi-0.116.1 fastapi-cli-0.0.16 fastapi-cloud-cli-0.5.1 fastar-0.6.0 greenlet-3.0.3 h11-0.16.0 httpcore-1.0.9 httptools-0.7.1 httpx-0.28.1 idna-3.7 importlib-resources-6.5.2 itsdangerous-2.2.0 jinja2-3.1.6 lxml-6.0.2 mako-1.3.10 markdown-it-py-3.0.0 markupsafe-3.0.2 mdurl-0.1.2 packaging-25.0 prettytable-3.7.0 pydantic-2.10.6 pydantic-core-2.27.2 pygments-2.17.2 pyjwt-2.10.1 pyotp-2.9.0 pyparsing-3.0.9 python-cas-1.6.0 python-dotenv-1.2.1 python-multipart-0.0.20 pyyaml-6.0.2 requests-2.32.4 rich-14.2.0 rich-toolkit-0.16.0 rignore-0.7.6 scap-4.228.0 sentry-sdk-2.45.0 setuptools-78.1.1 shellingham-1.5.4 six-1.17.0 sniffio-1.3.1 sqlalchemy-2.0.32 starlette-0.47.2 tomli-2.3.0 typer-0.20.0 typing-extensions-4.15.0 urllib3-2.5.0 uvicorn-0.38.0 uvloop-0.22.1 watchfiles-1.1.1 wcwidth-0.2.5 websockets-15.0.1 zipp-3.23.0

INFO: Scap "4.228.0" for "bullseye" successfully installed at /var/lib/scap/scap
16:51:10 Syncing installation material to 9 scap targets from "deployment-deploy04.deployment-prep.eqiad1.wikimedia.cloud"
16:51:10 scap-sync-wheels-to-targets:   0% (ok: 0; fail: 0; left: 9)
16:51:12 scap-sync-wheels-to-targets: 100% (in-flight: 0; ok: 9; fail: 0; left: 0)
16:51:12 scap-sync-install-script-to-targets:   0% (ok: 0; fail: 0; left: 9)
16:51:13 scap-sync-install-script-to-targets: 100% (in-flight: 0; ok: 9; fail: 0; left: 0)
16:51:13 Installing 9 scap targets
16:51:13 scap-install-to-targets:   0% (ok: 0; fail: 0; left: 9)
16:51:31 scap-install-to-targets: 100% (in-flight: 0; ok: 9; fail: 0; left: 0)
16:51:31 Installation of scap version "4.228.0" completed for 10 hosts
bd808@mbp03:~/projects/wmf/releng/scap$ ./release-scripts/scaps-installed-in-beta
10 hosts will be targeted:
deployment-deploy04.deployment-prep.eqiad1.wikimedia.cloud,deployment-echostore02.deployment-prep.eqiad1.wikimedia.cloud,deployment-jobrunner05.deployment-prep.eqiad1.wikimedia.cloud,deployment-mediawiki[13-14].deployment-prep.eqiad1.wikimedia.cloud,deployment-mwmaint03.deployment-prep.eqiad1.wikimedia.cloud,deployment-restbase05.deployment-prep.eqiad1.wikimedia.cloud,deployment-sessionstore06.deployment-prep.eqiad1.wikimedia.cloud,deployment-webperf[21-22].deployment-prep.eqiad1.wikimedia.cloud
FORCE mode enabled, continuing without confirmation
100.0% (10/10) success ratio (>= 100.0% threshold) for command: 'sudo -u scap scap version'.
100.0% (10/10) success ratio (>= 100.0% threshold) of nodes successfully executed all commands.
4.228.0
Stashbot added a comment.Fri, Nov 28, 4:54 PM

Mentioned in SAL (#wikimedia-releng) [2025-11-28T16:54:13Z] <bd808> Enabled beta-scap-sync-world job to see if scap updated fixed T411235

bd808 closed this task as Resolved.Fri, Nov 28, 5:07 PM
bd808 claimed this task.
bd808 moved this task from To Triage to Backlog on the Beta-Cluster-Infrastructure board.
Restricted Application added a project: User-bd808. · View Herald TranscriptFri, Nov 28, 5:07 PM
Reedy renamed this task from Beta cluster scap using php8.1 container; php8.3 is now required to Beta cluster scap using php8.1 container; php8.2 is now required.Fri, Nov 28, 10:42 PM
bd808 added a parent task: T358666: Drop PHP 8.1 support from MediaWiki.Mon, Dec 1, 4:20 PM
Krinkle mentioned this in T360995: Migrate Wikimedia production from PHP 8.1 to PHP 8.3.Tue, Dec 2, 6:46 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits