When jobs are run on the gallium server, they can access the Zuul merges by fetching from /srv/ssd/zuul/git
A slave on a remote host will not be able to do so :/
We could either:
Version: wmf-deployment
Severity: enhancement
Change 71968 had a related patch set uploaded by Hashar:
contint: publish Zuul git repositories
Patch merged in. The apache rules had to be tweaked with - https://gerrit.wikimedia.org/r/81930
Tests:
From a Jenkins slave:
hashar@lanthanum:/tmp$ git clone http://integration.wikimedia.org/zuul/git/sartoris
Cloning into 'sartoris'...
remote: Counting objects: 546, done.
remote: Compressing objects: 100% (251/251), done.
remote: Total 546 (delta 297), reused 499 (delta 269)
Receiving objects: 100% (546/546), 88.86 KiB, done.
Resolving deltas: 100% (297/297), done.
hashar@lanthanum:/tmp$
From Gallium (Jenkins master and slave):
hashar@gallium:/tmp$ git clone http://integration.wikimedia.org/zuul/git/sartoris
Cloning into 'sartoris'...
remote: Counting objects: 546, done.
remote: Compressing objects: 100% (251/251), done.
remote: Total 546 (delta 297), reused 499 (delta 269)
Receiving objects: 100% (546/546), 88.86 KiB, done.
Resolving deltas: 100% (297/297), done.
hashar@gallium:/tmp$
From a remote host:
amusso@aeriale:/tmp$ git clone http://integration.wikimedia.org/zuul/git/sartoris
Cloning into 'sartoris'...
fatal: unable to access 'http://integration.wikimedia.org/zuul/git/sartoris/': The requested URL returned error: 403
amusso@aeriale:/tmp$
The 403 is working as expected.
Change 82625 had a related patch set uploaded by Hashar:
contint: publish Zuul git over git protocol
git-http-backend is bugged and hangs whenever we attempt to clone huge repositories. That is bug 53683.
Instead, we can use git daemon which does not have the issue. https://gerrit.wikimedia.org/r/82625
And that is working for me now. I even started migrated some jobs to use the git protocol. Thank you Alexandros!