Page MenuHomePhabricator

Update list of Gerrit repositories indexed on wikimedia.biterg.io [Feb 2020]
Closed, ResolvedPublic

Description

$:acko\> more ./foo.sh 
#!/bin/bash
# Find new Wikimedia Gerrit repositories to add to indexing in wikimedia.biterg.io
# https://phabricator.wikimedia.org/T218519
# Licensed under CC0 1.0 Universal - https://creativecommons.org/publicdomain/zero/1.0/deed.en

ssh -l aklapper -p 29418 gerrit.wikimedia.org gerrit ls-projects | sort > gerritrepos.txt
curl -s https://gitlab.com/Bitergia/c/Wikimedia/sources/raw/master/projects.json | jq -r '.Wikimedia.git[]' | grep "https://gerrit-replica.wikimedia.org/r/" | cut -c 40- | sort > bitergiarepos.txt
echo "=== New Gerrit repos to add to Bitergia:"
comm -23 gerritrepos.txt bitergiarepos.txt
echo "=== Repos not present anymore in Gerrit:"
comm -23 bitergiarepos.txt gerritrepos.txt
rm bitergiarepos.txt gerritrepos.txt
echo "=== Now go and update https://gitlab.com/Bitergia/c/Wikimedia/sources/blob/master/projects.json !"

$:acko\> ./foo.sh 
=== New Gerrit repos to add to Bitergia:
labs/tools/apt-browser
labs/tools/bookreader
labs/tools/ci
labs/tools/coverme
labs/tools/dump-torrents
labs/tools/flaky-ci
labs/tools/ipchanges
labs/tools/mwpackages
labs/tools/newusers
labs/tools/ninthcircuit
labs/tools/phpcs
labs/tools/prism
labs/tools/qrcode-generator
labs/tools/reviewers
labs/tools/scotus-recordings
labs/tools/wikitext-deprecation
mediawiki/extensions/AControlImageLink
mediawiki/extensions/ConfigManager
mediawiki/extensions/FlexiSkin
mediawiki/extensions/MediaModeration
mediawiki/extensions/S5SlideShow
mediawiki/tools/codereview-archiver
mediawiki/tools/generateHookInterfaces
operations/software/atskafka
operations/software/gerrit/plugins/barricade
operations/software/gerrit/plugins/WikimediaBlocks
operations/software/gerrit/plugins/WikimediaWebSessions
phabricator/antivandalism
research/wikiworkshop
wikimedia/fundraising/analytics
wikimedia/TransparencyReport-private
=== Repos not present anymore in Gerrit:
operations/software/gerrit/plugins/barricade --filter-no-collection=true
operations/software/gerrit/plugins/WikimediaBlocks --filter-no-collection=true
operations/software/gerrit/plugins/WikimediaWebSessions --filter-no-collection=true
wikimedia/fundraising/analytics --filter-no-collection=true
wikimedia/TransparencyReport-private --filter-no-collection=true
=== Now go and update https://gitlab.com/Bitergia/c/Wikimedia/sources/blob/master/projects.json !

Ignore all the --filter-no-collection=true stuff when doing so.