Page MenuHomePhabricator

Setup private docker registry with authentication support in tools
Closed, ResolvedPublic

Description

So we can stop depending on dockerhub.

Needs both TLS and Basic Auth support.

Event Timeline

yuvipanda claimed this task.
yuvipanda raised the priority of this task from to Needs Triage.
yuvipanda updated the task description. (Show Details)
yuvipanda added projects: Cloud-Services, SRE.
yuvipanda subscribed.
yuvipanda triaged this task as Medium priority.Nov 23 2015, 6:04 PM
yuvipanda set Security to None.

Change 273840 had a related patch set uploaded (by Yuvipanda):
tools: Add authentication for docker registry

https://gerrit.wikimedia.org/r/273840

Change 273840 merged by Yuvipanda:
tools: Add authentication for docker registry

https://gerrit.wikimedia.org/r/273840

This now works properly, and I can push and pull!

However, docker has decided to do incredibly braindead things and ties image names to include a *hostname*, so I can't just have them be tools-docker-registry-01.

I'll probably need to setup a CNAME for tools-docker-registry.tools.eqiad.wmflabs...

Change 274148 had a related patch set uploaded (by Yuvipanda):
labs: Add CNAMES for tools specific things

https://gerrit.wikimedia.org/r/274148

Change 274148 merged by Yuvipanda:
labs: Add CNAMES for tools specific things

https://gerrit.wikimedia.org/r/274148

Change 274160 had a related patch set uploaded (by Yuvipanda):
labs: Set tools zonefile to be loaded

https://gerrit.wikimedia.org/r/274160

Change 274160 merged by Yuvipanda:
labs: Set tools zonefile to be loaded

https://gerrit.wikimedia.org/r/274160

Meh, that screwed up, reverting all the CNAME work...

Change 274179 had a related patch set uploaded (by Yuvipanda):
labs: Revert all work around CNAMEs for toollabs

https://gerrit.wikimedia.org/r/274179

Change 274180 had a related patch set uploaded (by Yuvipanda):
labs: Revert all work around CNAMEs for toollabs

https://gerrit.wikimedia.org/r/274180

Change 274180 merged by Yuvipanda:
labs: Revert all work around CNAMEs for toollabs

https://gerrit.wikimedia.org/r/274180

Is @Joe's T123628 a duplicate of this task? AFAIUI, there the registry would be a container and the name issue solved like other containers?

If there needs to be a CNAME, why not add it to operations/dns? Does it need to be in *.tools.eqiad.wmflabs?

Indeed it's the same, I've merged it in.

The reason it's not just a container is mostly because we don't have swift on the horizon yet and I'm *far* more averse to putting anything on NFS now :)

And I want it to be a CNAME under tools since this is tools specific, and not super general - only root can pull / push from it.

That ticket also has a far more complex setup for a ful PaaS system that we aren't doing yet (and when we do do it, we shouldn't be building our own but using a system like OpenShift / Deis), so have merged that into this.

Change 274179 abandoned by Yuvipanda:
labs: Revert all work around CNAMEs for toollabs

https://gerrit.wikimedia.org/r/274179

Change 278705 had a related patch set uploaded (by Yuvipanda):
labs: Add support for custom cnames in labs recursor

https://gerrit.wikimedia.org/r/278705

Change 278705 merged by Yuvipanda:
labs: Add support for custom cnames in labs recursor

https://gerrit.wikimedia.org/r/278705

Change 278964 had a related patch set uploaded (by Yuvipanda):
Revert "labs: Add support for custom cnames in labs recursor"

https://gerrit.wikimedia.org/r/278964

Change 278964 merged by Yuvipanda:
Revert "labs: Add support for custom cnames in labs recursor"

https://gerrit.wikimedia.org/r/278964

I've reverted all the CNAME work - @Joe pointed out that we'll want to have the registry available (in a readonly mode) to the whole world at some point anyway, so it's ok to use tools-docker-registry.wmflabs.org (and eventually, docker-registry.tools.wmflabs.org). So it is serving on port 443 on tools-docker-registry.wmflabs.org now.

I count this as done! \o/