Page MenuHomePhabricator

Installation failing on late_command.sh
Closed, ResolvedPublic

Description

During the installation of db2051 I am seeing that during the installation process it is failing with:

Execution of preseeded command "wget -O /tmp/late_command           │ │
│ │ http://apt.wikimedia.org/autoinstall/scripts/late_command.sh && sh  │ │
│ │ /tmp/late_command" failed with exit code 100

When forcing the installation to continue manually, once it reboots puppet doesn't get installed, and thus all the process fails with that.

root@db2051:~# puppet
-bash: puppet: command not found
root@db2051:~# dpkg -l | grep -i puppet
root@db2051:~#

Full installation log at: cumin1001:/var/log/wmf-auto-reimage/201906070606_marostegui_29784_db2051_codfw_wmnet.log

As per my chats with @MoritzMuehlenhoff this might be related to this change that was pushed yesterday: https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/514689/
I am assigning this task to @jbond for now so he can evaluate if it is indeed related to that or not.

@jbond db2051 can be re-imaged if you need to troubleshoot it on the same host it is failing.

Event Timeline

Sorry for this i have just pushed https://gerrit.wikimedia.org/r/c/operations/puppet/+/515017 so this should only be broken for sarin and neodyium now, sorry for the interruption and ping me if you still see issues

Sorry for this i have just pushed https://gerrit.wikimedia.org/r/c/operations/puppet/+/515017 so this should only be broken for sarin and neodyium now, sorry for the interruption and ping me if you still see issues

No problem - going to try to re-image. Will report back!
Thank you!

@jbond the install worked fine this time. Thanks for the fix.
I will leave up to you if you want to close this task as resolved or leave it open until you've found the proper fix.

Thanks!

Awesome, ill keep the ticket open so people now im playing with the other two servers

This should all be fixed no please reopen if more errors are observed