Page MenuHomePhabricator

scap deploy-local fails on aphlict servers
Closed, ResolvedPublic

Description

On aphlict1001, scap deploy-local --repo phabricator/deployment fails because it still points to deploy1001.eqiad.wmnet which doesn't exist:

phab-deploy@aphlict1001:~$ /usr/bin/scap deploy-local --repo phabricator/deployment -D log_json:False --verbose
10:36:36 Registering scripts in directory '/srv/deployment/phabricator/deployment-cache/revs/4547f31de8f69854e0cd9d3e0a802ce517360ee0/scap/scripts'
10:36:36 Fetch from: http://deploy1001.eqiad.wmnet/phabricator/deployment/.git
10:36:36 Running ['git', 'remote', 'set-url', 'origin', 'http://deploy1001.eqiad.wmnet/phabricator/deployment/.git'] with {'cwd': '/srv/deployment/phabricator/deployment-cache/cache', 'stdout': -1, 'stderr': -1, 'text': True, 'stdin': -3}
10:36:36 Command exited with code 0
10:36:36 Running ['git', 'fetch', '--tags', '--jobs', '1', '--no-recurse-submodules'] with {'cwd': '/srv/deployment/phabricator/deployment-cache/cache', 'stdout': -1, 'stderr': -1, 'text': True, 'stdin': -3}
10:36:36 Command exited with code 128
10:36:36 Unhandled error:
Traceback (most recent call last):
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/cli.py", line 532, in run
    exit_status = app.main(app.extra_arguments)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/deploy.py", line 161, in main
    getattr(self, stage)()
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/deploy.py", line 314, in fetch
    git.fetch(self.context.cache_dir, git_remote)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/git.py", line 348, in fetch
    gitcmd("fetch", *cmd, cwd=location)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/runcmd.py", line 91, in gitcmd
    return _runcmd(["git", subcommand] + list(args), **kwargs)
  File "/var/lib/scap/scap/lib/python3.7/site-packages/scap/runcmd.py", line 78, in _runcmd
    raise FailedCommand(argv, p.returncode, stdout, stderr)
scap.runcmd.FailedCommand: Command 'git fetch --tags --jobs 1 --no-recurse-submodules' failed with exit code 128;
stdout:

stderr:
fatal: unable to access 'http://deploy1001.eqiad.wmnet/phabricator/deployment/.git/': Could not resolve host: deploy1001.eqiad.wmnet

10:36:36 deploy-local failed: <FailedCommand> Command 'git fetch --tags --jobs 1 --no-recurse-submodules' failed with exit code 128;
stdout:

stderr:
fatal: unable to access 'http://deploy1001.eqiad.wmnet/phabricator/deployment/.git/': Could not resolve host: deploy1001.eqiad.wmnet

This does not bother puppet.

On aphlict2001, scap deploy-local --repo phabricator/deployment makes the puppet run fail. Running it manually as the phab-deploy user, we encounter a sudo prompt:

phab-deploy@aphlict2001:~$ /usr/bin/scap deploy-local --repo phabricator/deployment -D log_json:False --verbose                                                                                                         
10:32:09 Registering scripts in directory '/srv/deployment/phabricator/deployment-cache/revs/3f2dd1bf5761597244976c8a39822b08c0843199/scap/scripts'                                                                     
10:32:09 registered script? '/srv/deployment/phabricator/deployment-cache/revs/3f2dd1bf5761597244976c8a39822b08c0843199/scap/scripts/deploy-perms.sh' True                                                              
10:32:09 Fetch from: http://deploy2002.codfw.wmnet/phabricator/deployment/.git                                                                                                                                          
10:32:09 Running ['git', 'remote', 'set-url', 'origin', 'http://deploy2002.codfw.wmnet/phabricator/deployment/.git'] with {'cwd': '/srv/deployment/phabricator/deployment-cache/cache', 'stdout': -1, 'stderr': -1, 'tex
t': True, 'stdin': -3}                                                                                                                                                                                                  
10:32:09 Command exited with code 0                                                                                                                                                                                     
10:32:09 Running ['git', 'fetch', '--tags', '--jobs', '1', '--no-recurse-submodules'] with {'cwd': '/srv/deployment/phabricator/deployment-cache/cache', 'stdout': -1, 'stderr': -1, 'text': True, 'stdin': -3}         
10:32:09 Command exited with code 0                                                                                                                                                                                     
10:32:09 Update submodules                                                                                                                                                                                              
10:32:09 Fetch submodules                                                                                                                                                                                               
10:32:09 Remapping submodule /srv/deployment/phabricator/deployment-cache/cache to http://deploy2002.codfw.wmnet/phabricator/deployment/.git                                                                            
10:32:09 Updating .gitmodule: /srv/deployment/phabricator/deployment-cache/cache                                                                                                                                        
10:32:09 Running ['git', 'checkout', '.gitmodules'] with {'cwd': '/srv/deployment/phabricator/deployment-cache/cache', 'stdout': -1, 'stderr': -1, 'text': True, 'stdin': -3}                                           
10:32:09 Command exited with code 0                                                                                                                                                                                     
10:32:09 Running ['git', 'config', '--list', '--file', '.gitmodules'] with {'cwd': '/srv/deployment/phabricator/deployment-cache/cache', 'stdout': -1, 'stderr': -1, 'text': True, 'stdin': -3}                         
10:32:09 Command exited with code 0                                                                                                                                                                                     
10:32:09 Syncing out submodules                                                                                                                                                                                         
10:32:09 Running ['git', 'submodule', 'sync', '--recursive'] with {'cwd': '/srv/deployment/phabricator/deployment-cache/cache', 'stdout': -1, 'stderr': -1, 'text': True, 'stdin': -3}                                  
10:32:09 Command exited with code 0                                                                                                                                                                                     
10:32:09 Running ['git', 'submodule', 'update', '--init', '--recursive', '--jobs', '1'] with {'cwd': '/srv/deployment/phabricator/deployment-cache/cache', 'stdout': -1, 'stderr': -1, 'text': True, 'stdin': -3}       
10:32:09 Command exited with code 0                                                                                                                                                                                     
10:32:09 Running ['git', 'rev-parse', '--verify', 'HEAD'] with {'cwd': '/srv/deployment/phabricator/deployment-cache/revs/3f2dd1bf5761597244976c8a39822b08c0843199', 'stdout': -1, 'stderr': -1, 'text': True, 'stdin': 
-3}                                                                                                                                                                                                                     
10:32:09 Command exited with code 0                                                                                                                                                                                     
10:32:09 Revision directory already exists (use --force to override)                                                                                                                                                    
10:32:09 Registering scripts in directory '/srv/deployment/phabricator/deployment-cache/revs/3f2dd1bf5761597244976c8a39822b08c0843199/scap/scripts'                                                   
10:32:09 registered script? '/srv/deployment/phabricator/deployment-cache/revs/3f2dd1bf5761597244976c8a39822b08c0843199/scap/scripts/deploy-perms.sh' True                                            
10:32:09 Source basepath: /srv/deployment/phabricator/deployment-cache/revs/3f2dd1bf5761597244976c8a39822b08c0843199/.git/config-files                                                                
10:32:09 Rendering config_file: /srv/deployment/phabricator/deployment-cache/revs/3f2dd1bf5761597244976c8a39822b08c0843199/phabricator/conf/local/local.json using /etc/phabricator/config.yaml       
10:32:09 Rendering config_file: /srv/deployment/phabricator/deployment-cache/revs/3f2dd1bf5761597244976c8a39822b08c0843199/phabricator/conf/local/mail.json using /etc/phabricator/config.yaml        
10:32:09 Rendering config_file: /srv/deployment/phabricator/deployment-cache/revs/3f2dd1bf5761597244976c8a39822b08c0843199/phabricator/conf/local/phd.json using /etc/phabricator/config.yaml         
10:32:09 Rendering config_file: /srv/deployment/phabricator/deployment-cache/revs/3f2dd1bf5761597244976c8a39822b08c0843199/phabricator/conf/local/vcs.json using /etc/phabricator/config.yaml         
10:32:09 Rendering config_file: /srv/deployment/phabricator/deployment-cache/revs/3f2dd1bf5761597244976c8a39822b08c0843199/phabricator/conf/local/www.json using /etc/phabricator/config.yaml         
10:32:09 Rendering config_file: /srv/deployment/phabricator/deployment-cache/revs/3f2dd1bf5761597244976c8a39822b08c0843199/phabricator/support/preamble.php using /etc/phabricator/config.yaml        
10:32:09 Rendering config_file: /srv/deployment/phabricator/deployment-cache/revs/3f2dd1bf5761597244976c8a39822b08c0843199/phabricator/support/redirect_config.json using /etc/phabricator/config.yaml
10:32:09 Registering scripts in directory '/srv/deployment/phabricator/deployment-cache/revs/3f2dd1bf5761597244976c8a39822b08c0843199/scap/scripts'       
10:32:09 registered script? '/srv/deployment/phabricator/deployment-cache/revs/3f2dd1bf5761597244976c8a39822b08c0843199/scap/scripts/deploy-perms.sh' True
10:32:09 Executing check 'config_deploy'                                                                    
                                                                                                            
We trust you have received the usual lecture from the local System                                          
Administrator. It usually boils down to these three things:                                                 
                                                                                                            
    #1) Respect the privacy of others.                                                                      
    #2) Think before you type.                                                                              
    #3) With great power comes great responsibility.                                                        
                                                                                                            
[sudo] password for phab-deploy: 10:32:39 Check 'config_deploy' exceeded 30.0s timeout

Event Timeline

thanks for reporting. This is more or less a duplicate of T329908.

also see T326668 (scap failed on bullseye targets, that is fixed now. aphlict is on bullseye. most things that are scap targets are not bullseye, I think.

eoghan claimed this task.

This is fixed now, aphlict2001 is happy. See the update here for details: T322369#8690007