Page MenuHomePhabricator

Experiment with Swift as docker registry backend
Closed, ResolvedPublic

Description

Docker registry supports using openstack swift to read/write images, we'll need to setup access to our existing swift cluster and run some experiments. The swift cluster in esams is currently idle and can be used for such experiments without impacting production. Latency will suffer a bit both from eqiad <-> esams networking and the fact that esams has both data and metadata on spinning disks (eqiad/codfw have metadata on SSD and data on spinning disks).

  • Setup LVS for swift in esams
  • Add docker registry production credentials to swift esams
  • Create container for docker registry user to read/write

Related Objects

Event Timeline

Change 318010 had a related patch set uploaded (by Filippo Giunchedi):
esams: introduce svc records for swift

https://gerrit.wikimedia.org/r/318010

Change 318010 merged by Filippo Giunchedi:
esams: introduce svc records for swift

https://gerrit.wikimedia.org/r/318010

Change 318145 had a related patch set uploaded (by Filippo Giunchedi):
swift: add lvs configuration for esams

https://gerrit.wikimedia.org/r/318145

Change 318148 had a related patch set uploaded (by Filippo Giunchedi):
hieradata: add swift user for docker_registry

https://gerrit.wikimedia.org/r/318148

Change 318148 merged by Filippo Giunchedi:
hieradata: add swift user for docker_registry

https://gerrit.wikimedia.org/r/318148

Change 318646 had a related patch set uploaded (by Filippo Giunchedi):
add swift.svc CNAME for codfw/eqiad

https://gerrit.wikimedia.org/r/318646

Change 318646 merged by Filippo Giunchedi:
add swift.svc CNAME for codfw/eqiad

https://gerrit.wikimedia.org/r/318646

The docker:registry user is setup in eqiad/codfw/esams, though esams LVS setup isn't completed as noted in https://gerrit.wikimedia.org/r/318145. For now we can use codfw though for tests. Leaving this open since the LVS esams setup is something we want/need anyway. I've also setup convenience DNS cnames as swift.svc.SITE.wmnet.

fgiunchedi changed the task status from Open to Stalled.Nov 17 2016, 11:11 PM
fgiunchedi triaged this task as Medium priority.
fgiunchedi updated the task description. (Show Details)

Stalling on the fact that it'd be nice to be using esams for this, though codfw will do for now.

Change 318145 abandoned by Filippo Giunchedi:
swift: add lvs configuration for esams

Reason:
swift in esams is going away

https://gerrit.wikimedia.org/r/318145

We're using codfw to test swift as docker registry backend.