Page MenuHomePhabricator

Sort out a process to add new Github repositories to Git indexing
Open, LowestPublic

Description I am afraid that this does not happen automagically.

This is about the "git" section in for entries that start with

Similar to T218519.

Event Timeline

Aklapper lowered the priority of this task from Low to Lowest.Mar 20 2019, 11:22 AM
Aklapper moved this task from To triage to Apr-Jun 2019 on the Developer-Advocacy board.

There is nothing in the JSON output of that indicates whether a Github repository has been forked but I excluded those forked repos in T186736. Lots of noise so identifying new repos will not be easy.

Code, basically:

wget -q "" -O githubwmf01.json
cat githubwmf*.json | jq -r '.[] | select(.description|values | contains("irror") | not).html_url' > githubrepos.tmp
cat githubrepos.tmp >> githubreposall.tmp
(repeat for all pages and all groups)
cat githubreposall.tmp | sort > githubrepos.txt
curl -s | jq -r '.Wikimedia.git[]' | grep "" | sort > bitergiarepos.txt
echo "=== New Github repos to potentially add to Bitergia (if not Gerrit mirrors):"
comm -23 githubrepos.txt bitergiarepos.txt

Maybe it's way easier to just index any and all repo on Github under the groups we're interested in.