All striker repos have been moved.

extension repos appear to be just mirrors.

A bunch of other active repos have been disabled. We wrote docs how to use push over https if needed.

And finally there has been one active candidate moved that poppet up after git-ssh was recently shut down for real. This was at T321350.

arr. ACK. "Query Overheated. This query took too long, so only some results are shown. "

In T191182#8343504, @Dzahn wrote:

arr. ACK. "Query Overheated. This query took too long, so only some results are shown. "

Same. But I have this information elsewhere.

14 repos by my count (using a script from gitlab-migration-stats)

These repos meet the following criteria:

1. status: active
2. they are not observing any repos; i.e., not mirrors
3. if the name is "private n" then policy.view is not public (3 repos)

see more at: data.releng.team.

Updated time is the dateModified reported by phabricator, not the repos themselves.

Awesome!

When looking at phabricator translations (T321350) I found out the Gerrit deployment repo phabricator/deployment refers to repositories hosted on Diffusion and filed T321380 which has some of the repositories from this list. I was hit by the Query overheated and missed finding the proper SQL query to extract them all.

In T191182#8343579, @thcipriani wrote:

14 repos by my count (using a script from gitlab-migration-stats)

We talked about this list in today's gitlab IC meeting.

I said I will try to look at all the ones that are not Phabricator itself or internal and Brennen wants to look at the Phabricator internal ones.

So going throught this list:

	name	url	updated_time
5	tools-grrrit-wm (diffusion)	https://phabricator.wikimedia.org/diffusion/TGWM/tools-grrrit-wm.git	2022-10-20 06:00:00
7	WikiSP: MediaWiki Config (diffusion)	https://phabricator.wikimedia.org/diffusion/WSP/wikisp-mw-config.git	2022-02-28 07:00:00
12	3d2png (diffusion)	https://phabricator.wikimedia.org/diffusion/TDTP/3d2png.git	2019-07-04 06:00:00
13	SCAP Extension Framework (diffusion)	https://phabricator.wikimedia.org/diffusion/SCAPEXT/scap-ext.git	2019-07-04 06:00:00
14	extension-2ColConflict (diffusion)	https://phabricator.wikimedia.org/diffusion/ETCC/extension-2colconflict.git	2019-07-04 06:00:00

3d2png is meanwhile already not active anymore. It says "has moved to Gerrit" and inactive.

• tools-grrrit-wm - inactive
• WikiSP: MediaWiki Config - deactivated
• 3d2png - inactive
• SCAP Extension Framework - deactivated
• extension-2ColConflict - inactive

In T191182#8432406, @Dzahn wrote:

• SCAP Extension Framework - active (scap itself recently moved to gitlab so this should also move, right?)

I just deactivated it. I only have vague memories about what it is.

Hello @Galahad we see you are using this repository: https://phabricator.wikimedia.org/source/wikisp-mw-config/ on Phabricator Diffusion. We are currently going through the very few remaining repos on Phabricator and would like to encourage moving repos to either our new self-hosted Gitlab or Gerrit. How would you feel about that? We would of course help to import the data. Best, Daniel

In T191182#8432421, @thcipriani wrote:

In T191182#8432406, @Dzahn wrote:

• SCAP Extension Framework - active (scap itself recently moved to gitlab so this should also move, right?)

I just deactivated it. I only have vague memories about what it is.

Thanks! I think this means if we subtract the "part of Phabricator itself / internal / secret" ones from the original list of 14 then there is literally only 1 active one left that has a maintainer outside SRE or releng. And I pinged the user right above.

In T191182#8432427, @Dzahn wrote:

Hello @Galahad we see you are using this repository: https://phabricator.wikimedia.org/source/wikisp-mw-config/ on Phabricator Diffusion. We are currently going through the very few remaining repos on Phabricator and would like to encourage moving repos to either our new self-hosted Gitlab or Gerrit. How would you feel about that? We would of course help to import the data. Best, Daniel

You already merged the repos onto GitLab a few months ago. :)

In T191182#8432465, @Galahad wrote:

You already merged the repos onto GitLab a few months ago. :)

Oh man, I know the name sounded familiar :) Sorry about the double ping. I just failed to set this to inactive then I guess. I'll fix that right now.

thank you :)

Mentioned in SAL (#wikimedia-operations) [2022-11-30T21:41:54Z] <mutante> phabricator - deactivating diffusion repo wikisp-mw-config T191182

In T191182#8343579, @thcipriani wrote:

14 repos by my count (using a script from gitlab-migration-stats)

@brennen We are now down to only things starting with phabricator-* (or Arcanist which is also part of it) and the 3 private repos.

	name	url	updated_time
1	phabricator-Sprint (diffusion)	https://phabricator.wikimedia.org/diffusion/PHSP/phabricator-sprint.git	2022-10-20 06:00:00
2	Arcanist (diffusion)	https://phabricator.wikimedia.org/diffusion/ARC/arcanist.git	2022-10-20 06:00:00
3	phabricator-extensions (diffusion)	https://phabricator.wikimedia.org/diffusion/PHEX/phab-extensions.git	2022-10-20 06:00:00
4	phabricator-translatewiki (diffusion)	https://phabricator.wikimedia.org/diffusion/PHTW/phabricator-translatewiki.git	2022-10-20 06:00:00
6	private repo 1	private repo 1	2022-03-03 07:00:00
8	private repo 0	private repo 0	2022-02-22 07:00:00
9	private repo 2	private repo 2	2021-05-14 06:00:00
10	phabricator-Tools (diffusion)	https://phabricator.wikimedia.org/diffusion/PHTO/phabricator-tools.git	2021-03-09 07:00:00
11	Phabricator (diffusion)	https://phabricator.wikimedia.org/diffusion/PHAB/phabricator.git	2020-02-11 07:00:00

@thcipriani Got anything about the private repos?

Without having changed anything yet, the current status looks like this. 4 out of 6 are already "Publishing Disabled". It's just that that is a separate status from being "Active". Separate button in the admin UI. So only 2 out of these are actually active with enabled publishing:

phabricator-extensions - Active
phabricator-translatewiki - Active

phabricator-Tools - Publishing Disabled
Phabricator - Publishing Disabled
phabricator-Sprint - Publishing Disabled
Arcanist - Publishing Disabled

In T191182#8433546, @Dzahn wrote:

phabricator-extensions - Active

Guess that's a question for RelEng regarding deployments etc

phabricator-translatewiki - Active

cf. T321350: Phabricator translations can no more be received due to decommissioning of git-ssh

At this point let's check one more time what "Active" really means. Because it does not mean it's not viewable when inactive and also does not mean necessarily it has no URIs to clone from and "publishing enabled" is a separate switch.

So https://secure.phabricator.com/book/phabricator/article/diffusion_managing/ says

Basics: Deactivate Repository

Repositories can be deactivated. Deactivating a repository has these effects:

    the repository will no longer be updated;
    users will no longer be able to clone/fetch/checkout the repository;
    users will no longer be able to push to the repository; and
    the repository will be hidden from view in default queries.

FYI, I updated related docs in https://www.mediawiki.org/w/index.php?title=Phabricator%2FDiffusion&type=revision&diff=5633642&oldid=5585984

Thank you, @Aklapper :)

This one is now just waiting for the migration of the "phab-extensions" https://phabricator.wikimedia.org/source/phab-extensions/ repo to either Gerrit or Gitlab.

(cc: @brennen who wanted to look at that)

After that I expect this to be resolved.

@brennen has moved the phab-extensions repo

https://gitlab.wikimedia.org/repos/phabricator/extensions

thank you:)

@thcipriani using the "02-active-diffusion-repos.py" script from https://gitlab.wikimedia.org/repos/releng/gitlab-migration-stats (that's what you used, right?) I now get 0 results. Are we done?

It's just that in the UI I still see one secret repo and the steward scripts repo .. and the "query overheated" message.

Change 907947 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] deployment_server: remove iegreview with source phabricator

https://gerrit.wikimedia.org/r/907947

Change 907947 merged by Dzahn:

[operations/puppet@production] deployment_server: remove iegreview with source phabricator

https://gerrit.wikimedia.org/r/907947

@thcipriani: Could you answer T191182#8722238 please? Thanks a lot! :)

I think stewards have (one of the) last repos in Diffusion, because it is a private one. FYI, I filled T346937: GitLab Private Repository Request for: Wikimedia Stewards and T346924 to facilitate migrating that repository.

Per T347577#9284700 last bullet point we have 10 more non-public read/write repos in Diffusion to tackle in order to make Diffusion not host any code repository canonically. (Not directly related to using Differential as a review tool, still IMO in scope here.)

Acting as a Phabricator admin, I unlocked most non-public read&write Git repositories in Diffusion via sudo /srv/phab/phabricator/bin/policy unlock in order to investigate. When a code repository was empty, I made it viewable by public. That means we are left with:

• R2344: not empty but had only one initial boilerplate commit by @Kearabilwe 5.5 years ago and can very likely be archived
• R2115: to be handled by Release-Engineering-Team
• R2992: sent an email to @Ameisenigel to consider making it public done
• R3019: to be handled by WMDE in T349847

@Aklapper Let's just archive R2344 (I can't see it though).

R2344:
With boilerplate content containing terms like "Watches" or "Jewellery" and at least one postal address, I decided to delete R2344 instead.

aklapper@phab1004:~$     sudo /srv/phab/phabricator/bin/remove destroy R2344
Destroying PhabricatorRepository R2344...
Permanently destroyed 1 object.
      - Database records for repository "tool-wikiintent" were destroyed, but
        this script does not remove working copies on disk. If you also want
        to destroy the repository working copy, manually remove
        "/srv/repos/2344/".

Cool :) thank you! @Aklapper