Page MenuHomePhabricator

Three repos do not replicate properly to Github
Closed, ResolvedPublic

Description

The Gerrit replication fails to replicate three repositories to Github:

$ gerrit show-queue --wide
Task     State        StartTime         Command
------------------------------------------------------------------------------
a20e4813 12:55:23.271 12:54:23.271      (retry 2318) push git@github.com:wikimedia/mediawiki-services-mathoid
c2e01c53 12:55:46.253 12:54:46.253      (retry 2271) push git@github.com:wikimedia/operations-debs-bloomd
22d25889 12:55:46.254 12:54:46.254      (retry 2346) push git@github.com:wikimedia/thumbor-svg-engine
------------------------------------------------------------------------------

Ie:

mediawiki/services/mathoid.git
operations/debs/bloomd.git
thumbor/svg-engine.git

bloomd && svg-engine

From Gerrit server side logs:

[2015-12-16 00:03:27,205] WARN  com.googlesource.gerrit.plugins.replication.ReplicationQueue :
    Missing repository created; retry replication to git@github.com:wikimedia/operations-debs-bloomd
[2015-12-16 00:03:32,123] WARN  com.googlesource.gerrit.plugins.replication.ReplicationQueue :
    Missing repository created; retry replication to git@github.com:wikimedia/thumbor-svg-engine

Repositories are missing from Github:

https://github.com/wikimedia/operations-debs-bloomd -> 404
https://github.com/wikimedia/thumbor-svg-engine -> 404

Mathoid

Mathoid has a slightly different issue:

[2015-12-16 00:04:27,535] ERROR com.googlesource.gerrit.plugins.replication.ReplicationQueue :
    Cannot replicate to git@github.com:wikimedia/mediawiki-services-mathoid
org.eclipse.jgit.errors.TransportException: git@github.com:wikimedia/mediawiki-services-mathoid:
    Missing unknown 1f59434d3d1d5cd874681c785b75d255be9f9a25

https://github.com/wikimedia/mediawiki-services-mathoid is redirected to https://github.com/wikimedia/mathoid

The missing commit is from July 2013, made to the gh-pages branch https://github.com/wikimedia/mathoid/commit/1f59434d3d1d5cd874681c785b75d255be9f9a25 . That is similar to T103503

Event Timeline

hashar created this task.Dec 16 2015, 1:04 PM
hashar raised the priority of this task from to Needs Triage.
hashar updated the task description. (Show Details)
hashar added a project: Gerrit.
hashar added a subscriber: hashar.
Restricted Application added subscribers: StudiesWorld, Aklapper. · View Herald TranscriptDec 16 2015, 1:04 PM

For Mathoid based on a fresh clone of the Gerrit project I did:

$ git remote add github https://github.com/wikimedia/mathoid
$ git fetch github
From https://github.com/wikimedia/mathoid
 * [new branch]      gh-pages   -> github/gh-pages
 * [new branch]      master     -> github/master
 * [new tag]         v0.2.9     -> v0.2.9

In Gerrit created a gh-pages branch pointing to tip of master. Then force pushed with author/committer forging rights:

$ git push -f origin github/gh-pages:gh-pages
 + be00b6f...1f59434 github/gh-pages -> gh-pages (forced update)

1f59434 being the tip of github gh-pages branch. That should solve the missing object ID.

Dropped force push / forge identities rights.

gerrit show-queue --wide is now empty.

From the Gerrit logs

com.googlesource.gerrit.plugins.replication.ReplicationQueue:

[2015-12-16 13:11:58,482] WARN Missing repository created; retry replication to git@github.com:wikimedia/operations-debs-bloomd
[2015-12-16 13:11:58,826] WARN Missing repository created; retry replication to git@github.com:wikimedia/thumbor-svg-engine
[2015-12-16 13:12:59,170] WARN Missing repository created; retry replication to git@github.com:wikimedia/operations-debs-bloomd
[2015-12-16 13:12:59,545] WARN Missing repository created; retry replication to git@github.com:wikimedia/thumbor-svg-engine
[2015-12-16 13:13:59,917] WARN Missing repository created; retry replication to git@github.com:wikimedia/operations-debs-bloomd
[2015-12-16 13:14:00,301] WARN Missing repository created; retry replication to git@github.com:wikimedia/thumbor-svg-engine
git@github.com:wikimedia/operations-debs-bloomd
[2015-12-16 13:15:01,007] WARN Missing repository created; retry replication to git@github.com:wikimedia/thumbor-svg-engine
[2015-12-16 13:16:01,622] WARN Missing repository created; retry replication to git@github.com:wikimedia/operations-debs-bloomd
[2015-12-16 13:16:02,631] WARN Missing repository created; retry replication to git@github.com:wikimedia/thumbor-svg-engine
[2015-12-16 13:17:03,095] WARN Missing repository created; retry replication to git@github.com:wikimedia/operations-debs-bloomd
[2015-12-16 13:17:04,174] WARN Missing repository created; retry replication to git@github.com:wikimedia/thumbor-svg-engine
[2015-12-16 13:18:04,913] WARN Missing repository created; retry replication to git@github.com:wikimedia/thumbor-svg-engine
hashar closed this task as Resolved.Dec 16 2015, 1:24 PM
hashar claimed this task.

All populated:

https://github.com/wikimedia/operations-debs-bloomd
https://github.com/wikimedia/thumbor-svg-engine

Fetched mathoid from Github:

$ git fetch github
From https://github.com/wikimedia/mathoid
   78712a7..be00b6f  master     -> github/master

Where 78712a7 is from 5 weeks ago. So the replication caught up there.