Maniphest T362021

daemons.log on phab1004
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Aklapper
	Apr 7 2024, 9:48 AM

Description

...because the Projects-Cleanup template has not always been followed over the last years so lots of noise in there, potentially hiding other issues. Found because I was originally looking for pointers in T274559#9695403.

Confirm repo does not exist anymore, browser style (https://gerrit.wikimedia.org/g/path/to/deleted/repo.git) and local (git clone ssh://gerrit.wikimedia.org:29418/path/to/deleted/repo.git).
Then corresponding sudo /srv/phab/phabricator/bin/remove destroy rKILLKILLKILL for whatever it's called in Diffusion. Ignore some DB errors about edges.
FYI SELECT CONCAT("https://phabricator.wikimedia.org/diffusion/", r.id, "/manage/uris/") AS repoURI, r.name, u.uri FROM phabricator_repository.repository_uri u INNER JOIN phabricator_repository.repository r ON r.phid = u.repositoryPHID WHERE u.uri LIKE "%deleted/reponame%"; can sometimes also come handy.

Randomly mirroring repos around between four different systems based on idealistic incentives or questionable beliefs may have downsides; T359549: Drop our mirroring of code to Diffusion and empty the repos may have a point.

Related Objects

Mentioned In: T274559: Error trying to view previous git blame ("Skip past this commit" button): "reset() expects parameter 1 to be array, null given"
Mentioned Here: T274559: Error trying to view previous git blame ("Skip past this commit" button): "reset() expects parameter 1 to be array, null given"
T359549: Drop our mirroring of code to Diffusion and empty the repos

Event Timeline

Aklapper triaged this task as Low priority.Apr 7 2024, 9:48 AM

Aklapper created this task.

Aklapper mentioned this in T274559: Error trying to view previous git blame ("Skip past this commit" button): "reset() expects parameter 1 to be array, null given".

I think I destroyed all mirrored Diffusion repos throwing a HTTP 403 in the logs except for rNRDK (no idea what that one is doing). Those are/were all Gerrit mirrors.

There are also GitLab mirrors with errors with a misleading could not read Username for 'https://gitlab.wikimedia.org': No such device or address in the logs, e.g. R2394 trying to pull/mirror from non-existing https://gitlab.wikimedia.org/toolforge-repos/revi-kowikibots.git (random example).

aklapper@phab1004:~$ grep -r "Error while updating the" /var/log/phd/daemons.log.1 | grep "repository. {>} (CommandException) Command failed with error #255!" | cut -c 84- | sort -u
Error while updating the "rEHPR" repository. {>} (CommandException) Command failed with error #255!
Error while updating the "rNRDK" repository. {>} (CommandException) Command failed with error #255!
Error while updating the "rWRES" repository. {>} (CommandException) Command failed with error #255!
Error while updating the "tool-animanga-db-matcher" repository. {>} (CommandException) Command failed with error #255!
Error while updating the "tool-api-docs" repository. {>} (CommandException) Command failed with error #255!
Error while updating the "tool-axel" repository. {>} (CommandException) Command failed with error #255!
Error while updating the "tool-botutor" repository. {>} (CommandException) Command failed with error #255!
Error while updating the "tool-contentcontributor" repository. {>} (CommandException) Command failed with error #255!
Error while updating the "tool-discord-irc" repository. {>} (CommandException) Command failed with error #255!
Error while updating the "tool-milhistbot-bd808-test" repository. {>} (CommandException) Command failed with error #255!
Error while updating the "tool-phabricator-bug-status" repository. {>} (CommandException) Command failed with error #255!
Error while updating the "tool-revi-kowikibots" repository. {>} (CommandException) Command failed with error #255!
Error while updating the "tool-vipbot" repository. {>} (CommandException) Command failed with error #255!
Error while updating the "tool-wikishootme" repository. {>} (CommandException) Command failed with error #255!
Error while updating the "tool-xtools-legacy" repository. {>} (CommandException) Command failed with error #255!
Error while updating the "tool-ytcleaner" repository. {>} (CommandException) Command failed with error #255!

https://phabricator.wikimedia.org/diffusion/NRDK fails because https://gerrit-replica.wikimedia.org/r/node-rdkafka is a 403; https://gerrit.wikimedia.org/r/admin/repos/q/filter:node-rdkafka lists nothing, git clone ssh://gerrit.wikimedia.org:29418/node-rdkafka.git fails with a 403, thus I ran sudo ./bin/remove destroy rNRDK
WRES fails because could not read Username for 'https://github.com': No such device or address because https://github.com/wikimedia/wikimedia-research does not exist, thus I ran sudo ./bin/remove destroy rWRES (repo would now be https://gitlab.wikimedia.org/repos/sre/miscweb/research-landing-page but that's also archived)
https://phabricator.wikimedia.org/diffusion/EHPR fails to mirror because: Unexpected object type from git cat-file

Rest are tool repos still empty / not created yet in Gitlab.

Aklapper moved this task from To Triage to Administration (UI) on the Phabricator board.Apr 21 2024, 3:25 PM

Apart from T213246, all noise in the log seems to come from Toolforge repos that are non-existing / empty in Gitlab and Diffusion fails to mirror them, so I think for now that's the best effort that could be done.

Aklapper moved this task from Backlog to Done on the Release-Engineering-Team (Yakisfaction) board.May 13 2024, 9:04 PM

Clean up Diffusion's repo mirroring HTTP 403 failures in /var/log/phd/daemons.log on phab1004Closed, ResolvedPublicActions

Description

Related Objects

Event Timeline

Clean up Diffusion's repo mirroring HTTP 403 failures in /var/log/phd/daemons.log on phab1004
Closed, ResolvedPublic
Actions