Page MenuHomePhabricator

Installation failing on late_command.sh
Closed, ResolvedPublic

Description

During the installation of db2051 I am seeing that during the installation process it is failing with:

Execution of preseeded command "wget -O /tmp/late_command           │ │
│ │ http://apt.wikimedia.org/autoinstall/scripts/late_command.sh && sh  │ │
│ │ /tmp/late_command" failed with exit code 100

When forcing the installation to continue manually, once it reboots puppet doesn't get installed, and thus all the process fails with that.

root@db2051:~# puppet
-bash: puppet: command not found
root@db2051:~# dpkg -l | grep -i puppet
root@db2051:~#

Full installation log at: cumin1001:/var/log/wmf-auto-reimage/201906070606_marostegui_29784_db2051_codfw_wmnet.log

As per my chats with @MoritzMuehlenhoff this might be related to this change that was pushed yesterday: https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/514689/
I am assigning this task to @jbond for now so he can evaluate if it is indeed related to that or not.

@jbond db2051 can be re-imaged if you need to troubleshoot it on the same host it is failing.

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 7 2019, 7:06 AM
Marostegui updated the task description. (Show Details)Jun 7 2019, 7:09 AM
jbond added a comment.Jun 7 2019, 9:41 AM

Sorry for this i have just pushed https://gerrit.wikimedia.org/r/c/operations/puppet/+/515017 so this should only be broken for sarin and neodyium now, sorry for the interruption and ping me if you still see issues

Sorry for this i have just pushed https://gerrit.wikimedia.org/r/c/operations/puppet/+/515017 so this should only be broken for sarin and neodyium now, sorry for the interruption and ping me if you still see issues

No problem - going to try to re-image. Will report back!
Thank you!

@jbond the install worked fine this time. Thanks for the fix.
I will leave up to you if you want to close this task as resolved or leave it open until you've found the proper fix.

Thanks!

jbond added a comment.Jun 7 2019, 10:07 AM

Awesome, ill keep the ticket open so people now im playing with the other two servers

jbond closed this task as Resolved.Jun 19 2019, 2:26 PM

This should all be fixed no please reopen if more errors are observed