Page MenuHomePhabricator

scap.checks.CheckInvalid error during scap deploy
Closed, ResolvedPublic

Description

-- Opening log file: '/srv/deployment/integration/docroot/scap/log/scap-sync-2022-10-05-0005.log'
20:32:18 [deploy1002] Started deploy [integration/docroot@a136ce6]
20:32:18 [deploy1002] Deploying Rev: scap/sync/2022-10-05/0005 = 90cac44da0adb9425fca595416d717582ab8e7bb
20:32:18 [deploy1002] Started deploy [integration/docroot@a136ce6]: More minor cleanup
20:32:18 [deploy1002] 
== DEFAULT ==
:* doc1002.eqiad.wmnet
:* contint1001.wikimedia.org
:* doc2001.codfw.wmnet
:* contint2001.wikimedia.org
20:32:19 [contint1001.wikimedia.org] Unhandled error:
Traceback (most recent call last):
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/cli.py", line 524, in run
    exit_status = app.main(app.extra_arguments)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/deploy.py", line 159, in main
    status = self._execute_checks("before", stage, group)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/utils.py", line 404, in context_wrapper
    return func(*args, **kwargs)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/deploy.py", line 527, in _execute_checks
    chks = checks.load(self.config, check_environment)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/checks.py", line 176, in load
    name=name, environment=environment, **options
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/checks.py", line 241, in __init__
    self.validate()
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/script.py", line 75, in validate
    raise checks.CheckInvalid(msg)
scap.checks.CheckInvalid: the script 'restart-php-fpm' was not found
20:32:19 [contint1001.wikimedia.org] deploy-local failed: <CheckInvalid> {}
20:32:19 [deploy1002] ['/usr/bin/scap', 'deploy-local', '-v', '--repo', 'integration/docroot', '--force', '-g', 'default', 'fetch', '--refresh-config'] (ran as deploy-ci-docroot@contint1001.wikimedia.org) returned [70]: Unhandled error:
deploy-local failed: <CheckInvalid> {}

20:32:19 [doc1002.eqiad.wmnet] Unhandled error:
Traceback (most recent call last):
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/cli.py", line 524, in run
    exit_status = app.main(app.extra_arguments)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/deploy.py", line 159, in main
    status = self._execute_checks("before", stage, group)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/utils.py", line 404, in context_wrapper
    return func(*args, **kwargs)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/deploy.py", line 527, in _execute_checks
    chks = checks.load(self.config, check_environment)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/checks.py", line 176, in load
    name=name, environment=environment, **options
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/checks.py", line 241, in __init__
    self.validate()
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/script.py", line 75, in validate
    raise checks.CheckInvalid(msg)
scap.checks.CheckInvalid: the script 'restart-php-fpm' was not found
20:32:19 [doc1002.eqiad.wmnet] deploy-local failed: <CheckInvalid> {}
20:32:19 [deploy1002] ['/usr/bin/scap', 'deploy-local', '-v', '--repo', 'integration/docroot', '--force', '-g', 'default', 'fetch', '--refresh-config'] (ran as deploy-ci-docroot@doc1002.eqiad.wmnet) returned [70]: Unhandled error:
deploy-local failed: <CheckInvalid> {}

20:32:19 [doc2001.codfw.wmnet] Unhandled error:
Traceback (most recent call last):
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/cli.py", line 524, in run
    exit_status = app.main(app.extra_arguments)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/deploy.py", line 159, in main
    status = self._execute_checks("before", stage, group)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/utils.py", line 404, in context_wrapper
    return func(*args, **kwargs)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/deploy.py", line 527, in _execute_checks
    chks = checks.load(self.config, check_environment)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/checks.py", line 176, in load
    name=name, environment=environment, **options
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/checks.py", line 241, in __init__
    self.validate()
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/script.py", line 75, in validate
    raise checks.CheckInvalid(msg)
scap.checks.CheckInvalid: the script 'restart-php-fpm' was not found
20:32:19 [doc2001.codfw.wmnet] deploy-local failed: <CheckInvalid> {}
20:32:19 [deploy1002] ['/usr/bin/scap', 'deploy-local', '-v', '--repo', 'integration/docroot', '--force', '-g', 'default', 'fetch', '--refresh-config'] (ran as deploy-ci-docroot@doc2001.codfw.wmnet) returned [70]: Unhandled error:
deploy-local failed: <CheckInvalid> {}

20:32:23 [contint2001.wikimedia.org] Unhandled error:
Traceback (most recent call last):
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/cli.py", line 524, in run
    exit_status = app.main(app.extra_arguments)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/deploy.py", line 159, in main
    status = self._execute_checks("before", stage, group)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/utils.py", line 404, in context_wrapper
    return func(*args, **kwargs)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/deploy.py", line 527, in _execute_checks
    chks = checks.load(self.config, check_environment)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/checks.py", line 176, in load
    name=name, environment=environment, **options
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/checks.py", line 241, in __init__
    self.validate()
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/script.py", line 75, in validate
    raise checks.CheckInvalid(msg)
scap.checks.CheckInvalid: the script 'restart-php-fpm' was not found
20:32:23 [contint2001.wikimedia.org] deploy-local failed: <CheckInvalid> {}
20:32:23 [deploy1002] ['/usr/bin/scap', 'deploy-local', '-v', '--repo', 'integration/docroot', '--force', '-g', 'default', 'fetch', '--refresh-config'] (ran as deploy-ci-docroot@contint2001.wikimedia.org) returned [70]: Unhandled error:
deploy-local failed: <CheckInvalid> {}

20:32:23 [deploy1002] 4 targets had deploy errors
20:32:23 [deploy1002] 4 targets failed
20:32:23 [deploy1002] 4 of 4 default targets failed, exceeding limit
20:33:19 [deploy1002] 
== DEFAULT ==
:* doc1002.eqiad.wmnet
:* contint1001.wikimedia.org
:* doc2001.codfw.wmnet
:* contint2001.wikimedia.org
20:33:20 [contint1001.wikimedia.org] Unhandled error:
Traceback (most recent call last):
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/cli.py", line 524, in run
    exit_status = app.main(app.extra_arguments)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/deploy.py", line 159, in main
    status = self._execute_checks("before", stage, group)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/utils.py", line 404, in context_wrapper
    return func(*args, **kwargs)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/deploy.py", line 527, in _execute_checks
    chks = checks.load(self.config, check_environment)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/checks.py", line 176, in load
    name=name, environment=environment, **options
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/checks.py", line 241, in __init__
    self.validate()
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/script.py", line 75, in validate
    raise checks.CheckInvalid(msg)
scap.checks.CheckInvalid: the script 'restart-php-fpm' was not found
20:33:20 [contint1001.wikimedia.org] deploy-local failed: <CheckInvalid> {}
20:33:20 [deploy1002] ['/usr/bin/scap', 'deploy-local', '-v', '--repo', 'integration/docroot', '--force', '-g', 'default', 'rollback', '--refresh-config'] (ran as deploy-ci-docroot@contint1001.wikimedia.org) returned [70]: Unhandled error:
deploy-local failed: <CheckInvalid> {}

20:33:20 [doc1002.eqiad.wmnet] Unhandled error:
Traceback (most recent call last):
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/cli.py", line 524, in run
    exit_status = app.main(app.extra_arguments)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/deploy.py", line 159, in main
    status = self._execute_checks("before", stage, group)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/utils.py", line 404, in context_wrapper
    return func(*args, **kwargs)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/deploy.py", line 527, in _execute_checks
    chks = checks.load(self.config, check_environment)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/checks.py", line 176, in load
    name=name, environment=environment, **options
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/checks.py", line 241, in __init__
    self.validate()
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/script.py", line 75, in validate
    raise checks.CheckInvalid(msg)
scap.checks.CheckInvalid: the script 'restart-php-fpm' was not found
20:33:20 [deploy1002] ['/usr/bin/scap', 'deploy-local', '-v', '--repo', 'integration/docroot', '--force', '-g', 'default', 'rollback', '--refresh-config'] (ran as deploy-ci-docroot@doc1002.eqiad.wmnet) returned [70]: Unhandled error:
{"name": "deploy-local", "msg": "%s failed: <%s> %s", "args": ["deploy-local", "CheckInvalid", {}], "levelno": 40, "filename": "cli.py", "exc_text": null, "lineno": 404, "funcName": "_handle_exception", "created": 1665002000.8315997, "msecs": 831.5997123718262, "relativeCreated": 495.11098861694336}

20:33:21 [doc2001.codfw.wmnet] Unhandled error:
Traceback (most recent call last):
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/cli.py", line 524, in run
    exit_status = app.main(app.extra_arguments)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/deploy.py", line 159, in main
    status = self._execute_checks("before", stage, group)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/utils.py", line 404, in context_wrapper
    return func(*args, **kwargs)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/deploy.py", line 527, in _execute_checks
    chks = checks.load(self.config, check_environment)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/checks.py", line 176, in load
    name=name, environment=environment, **options
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/checks.py", line 241, in __init__
    self.validate()
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/script.py", line 75, in validate
    raise checks.CheckInvalid(msg)
scap.checks.CheckInvalid: the script 'restart-php-fpm' was not found
20:33:21 [doc2001.codfw.wmnet] deploy-local failed: <CheckInvalid> {}
20:33:21 [deploy1002] ['/usr/bin/scap', 'deploy-local', '-v', '--repo', 'integration/docroot', '--force', '-g', 'default', 'rollback', '--refresh-config'] (ran as deploy-ci-docroot@doc2001.codfw.wmnet) returned [70]: Unhandled error:
deploy-local failed: <CheckInvalid> {}

20:33:23 [contint2001.wikimedia.org] Unhandled error:
Traceback (most recent call last):
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/cli.py", line 524, in run
    exit_status = app.main(app.extra_arguments)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/deploy.py", line 159, in main
    status = self._execute_checks("before", stage, group)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/utils.py", line 404, in context_wrapper
    return func(*args, **kwargs)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/deploy.py", line 527, in _execute_checks
    chks = checks.load(self.config, check_environment)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/checks.py", line 176, in load
    name=name, environment=environment, **options
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/checks.py", line 241, in __init__
    self.validate()
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/script.py", line 75, in validate
    raise checks.CheckInvalid(msg)
scap.checks.CheckInvalid: the script 'restart-php-fpm' was not found
20:33:23 [contint2001.wikimedia.org] deploy-local failed: <CheckInvalid> {}
20:33:23 [deploy1002] ['/usr/bin/scap', 'deploy-local', '-v', '--repo', 'integration/docroot', '--force', '-g', 'default', 'rollback', '--refresh-config'] (ran as deploy-ci-docroot@contint2001.wikimedia.org) returned [70]: Unhandled error:
deploy-local failed: <CheckInvalid> {}

20:33:23 [deploy1002] 4 targets had deploy errors
20:33:23 [deploy1002] 4 targets failed
20:33:23 [deploy1002] Finished deploy [integration/docroot@a136ce6]: More minor cleanup (duration: 01m 05s)
20:33:23 [deploy1002] Finished deploy [integration/docroot@a136ce6] (duration: 01m 05s)

Event Timeline

Change 838909 had a related patch set uploaded (by Dduvall; author: Dduvall):

[mediawiki/tools/scap@master] scripts: Log (debug) registration of scripts

https://gerrit.wikimedia.org/r/838909

Change 838909 merged by jenkins-bot:

[mediawiki/tools/scap@master] scripts: Log (debug) registration of scripts

https://gerrit.wikimedia.org/r/838909

Change 838924 had a related patch set uploaded (by Dduvall; author: Dduvall):

[mediawiki/tools/scap@master] checks: Only validate checks for the current stage

https://gerrit.wikimedia.org/r/838924

Change 838924 merged by jenkins-bot:

[mediawiki/tools/scap@master] checks: Only validate checks for the current stage

https://gerrit.wikimedia.org/r/838924

dancy assigned this task to dduvall.
dancy renamed this task from scap deploy errors aren't helpful: deploy-local failed: <CheckInvalid> {} to scap.checks.CheckInvalid error during scap deploy.Oct 6 2022, 12:03 AM
dancy added a subscriber: hashar.