Page Menu
Home
Phabricator
Search
Configure Global Search
Log In
Paste
P17677
(An Untitled Masterwork)
Active
Public
Actions
Authored by
Tgr
on Nov 4 2021, 12:04 AM.
Edit Paste
Archive Paste
View Raw File
Subscribe
Mute Notifications
Award Token
Flag For Later
Tags
None
Referenced Files
F34729011: raw-paste-data.txt
Nov 4 2021, 12:04 AM
2021-11-04 00:04:24 (UTC+0)
Subscribers
None
tgr@deploy1002:/srv/mediawiki-staging$ scap sync-file php-1.38.0-wmf.6/extensions/GrowthExperiments 'Backport: [[gerrit:736518|Add Image: add HTTP proxy config (T290949)]] [[gerrit:736519|Add Image: Harden API response parsing]]'
___ ____
⎛ ⎛ ,----
\ //==--'
_//|,.·//==--' ____________________________
_OO≣=- ︶ ᴹw ⎞_§ ______ ___\ ___\ ,\__ \/ __ \
(∞)_, ) ( | ______/__ \/ /__ / /_/ / /_/ /
¨--¨|| |- ( / ______\____/ \___/ \__^_/ .__/
««_/ «_/ jgs/bd808 /_/
00:00:47 Checking for new runtime errors locally
00:00:48 Copying from deploy1002.eqiad.wmnet to deploy1002.eqiad.wmnet
00:00:48 Started rsync common
00:00:48 Finished rsync common (duration: 00m 00s)
00:00:48 Started cache_git_info
00:01:04 Finished cache_git_info (duration: 00m 15s)
00:01:04 Started sync-masters
sync-masters: 100% (ok: 1; fail: 0; left: 0)
00:01:10 Finished sync-masters (duration: 00m 06s)
00:01:10 Started sync-pull-masters
sync-pull-masters: 100% (ok: 1; fail: 0; left: 0)
00:01:12 Finished sync-pull-masters (duration: 00m 01s)
00:01:12 Started sync-check-canaries
check-canaries: 100% (ok: 9; fail: 0; left: 0)
00:01:13 Finished Canaries Synced (duration: 00m 01s)
00:01:13 Executing check 'Check endpoints for mw1415.eqiad.wmnet'
00:01:13 Executing check 'Check endpoints for mw1447.eqiad.wmnet'
00:01:13 Executing check 'Check endpoints for mw1417.eqiad.wmnet'
00:01:14 Executing check 'Check endpoints for mw1418.eqiad.wmnet'
00:01:14 Executing check 'Check endpoints for mw1448.eqiad.wmnet'
00:01:14 Executing check 'Check endpoints for mw1449.eqiad.wmnet'
00:01:14 Executing check 'Check endpoints for mw1416.eqiad.wmnet'
00:01:14 Executing check 'Check endpoints for mw1450.eqiad.wmnet'
00:01:14 Executing check 'Check endpoints for mw1414.eqiad.wmnet'
00:01:15 Finished Canary Endpoint Check Complete (duration: 00m 01s)
00:01:15 Waiting for canary traffic...
00:01:34 Executing check 'Logstash Error rate for mw1415.eqiad.wmnet'
00:01:34 Executing check 'Logstash Error rate for mw1447.eqiad.wmnet'
00:01:34 Executing check 'Logstash Error rate for mw1417.eqiad.wmnet'
00:01:34 Executing check 'Logstash Error rate for mw1418.eqiad.wmnet'
00:01:34 Executing check 'Logstash Error rate for mw1448.eqiad.wmnet'
00:01:34 Executing check 'Logstash Error rate for mw1449.eqiad.wmnet'
00:01:34 Executing check 'Logstash Error rate for mw1416.eqiad.wmnet'
00:01:34 Executing check 'Logstash Error rate for mw1450.eqiad.wmnet'
00:01:34 Executing check 'Logstash Error rate for mw1414.eqiad.wmnet'
00:01:34 Finished sync-check-canaries (duration: 00m 22s)
00:01:34 Started sync-proxies
sync-proxies: 100% (ok: 8; fail: 0; left: 0)
00:01:36 Finished sync-proxies (duration: 00m 02s)
00:01:36 Started sync-apaches
sync-apaches: 100% (ok: 347; fail: 0; left: 0)
00:01:45 Finished sync-apaches (duration: 00m 09s)
00:01:45 Running '/usr/local/sbin/check-and-restart-php php7.2-fpm 100' on 352 host(s)
00:01:48 /usr/bin/sudo -u root -- /usr/local/sbin/check-and-restart-php php7.2-fpm 100 (ran as mwdeploy@mwdebug1001.eqiad.wmnet) returned [2]: Restarting php7.2-fpm: free opcache 82 MB
2021-11-04 00:01:47,966 [ERROR] Error running command with poolcounter: timed out
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/poolcounter/client.py", line 383, in run
backend.get_lock(lock_type, key, **kwargs)
File "/usr/lib/python3/dist-packages/poolcounter/client.py", line 210, in get_lock
resp = self._command(req)
File "/usr/lib/python3/dist-packages/poolcounter/client.py", line 256, in _command
self._stream = self._connect()
File "/usr/lib/python3/dist-packages/poolcounter/client.py", line 270, in _connect
stream.connect((self.ipaddr, self.port))
socket.timeout: timed out
2021-11-04 00:01:47,968 [INFO] Error trying to release the lock: Trying to release a lock without a connection
2021-11-04 00:01:47,968 [INFO] Error trying to release the lock: Trying to release a lock without a connection
2021-11-04 00:01:47,968 [INFO] Error trying to release the lock: Trying to release a lock without a connection
2021-11-04 00:01:47,968 [INFO] Error trying to release the lock: Trying to release a lock without a connection
00:01:53 1 hosts had failures restarting php-fpm
00:01:53 Synchronized php-1.38.0-wmf.6/extensions/GrowthExperiments: Backport: [[gerrit:736518|Add Image: add HTTP proxy config (T290949)]] [[gerrit:736519|Add Image: Harden API response parsing]] (duration: 01m 05s)
Event Timeline
Tgr
created this paste.
Nov 4 2021, 12:04 AM
2021-11-04 00:04:24 (UTC+0)
Log In to Comment