Page MenuHomePhabricator

Set-up live-restore for docker containers
Closed, ResolvedPublic

Description

This will allow us to restart / upgrade docker daemon without having to kill all containers in the node.

https://docs.docker.com/engine/admin/live-restore/ is available from 1.12, and we should turn it on.

Event Timeline

Restricted Application added a project: Cloud-Services. · View Herald TranscriptFeb 4 2017, 3:39 AM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Change 335972 had a related patch set uploaded (by Yuvipanda):
tools: Turn on docker live-migrate for docker builder

https://gerrit.wikimedia.org/r/335972

I've it turned on for the docker builder hosts, and it looks good! It still stops containers that have interactive terminals attached to them, but otherwise long running containers seem to work fine! \o/ This will make docker upgrades in the future a lot less painful :D

Change 335972 merged by Yuvipanda:
tools: Turn on docker live-migrate for docker builder

https://gerrit.wikimedia.org/r/335972

Change 336487 had a related patch set uploaded (by Yuvipanda):
docker: Turn on live-restore for docker builder host on prod

https://gerrit.wikimedia.org/r/336487

Change 336487 merged by Yuvipanda:
docker: Turn on live-restore for docker builder host on prod

https://gerrit.wikimedia.org/r/336487

This is now done, and future docker upgrades are non-invasive :D

yuvipanda closed this task as Resolved.Feb 8 2017, 7:50 AM
yuvipanda claimed this task.
bd808 awarded a token.Feb 8 2017, 4:26 PM

Change 338416 had a related patch set uploaded (by Yuvipanda):
k8s: Upgrade docker turn on live-restore for prod

https://gerrit.wikimedia.org/r/338416

Change 338416 merged by Yuvipanda:
k8s: Upgrade docker turn on live-restore for prod

https://gerrit.wikimedia.org/r/338416

This has been rolled out to prod as well. \o/