Page MenuHomePhabricator

Index https://gitlab.wikimedia.org/toolforge-repos/ repos
Closed, ResolvedPublicFeature

Description

It would be nice to be able to search for usage of various MediaWiki and Toolforge features across the GitLab repos that Striker can create for Toolforge tools.

One example use case: find all projects using the mwclient python library affected by T371977: Removal of writeapi from siteinfo output breaks all mwclient-based bots, including stashbot (Server Admin Log)

Event Timeline

Per T268196: Figure out the future of codesearch in a GitLab world I think we should index all primary (non-fork) GitLab repos instead, since GitLab CE does not have any global search feature.

This looks like an example change where a repo was added to codesearch in the past:

https://gerrit.wikimedia.org/r/c/labs/codesearch/+/414060

I found that https://gerrit.wikimedia.org/r/plugins/gitiles/labs/codesearch/+/fae2553e35f901c6f678cb5b696681a35df1cd50/write_config.py#469 is configuring codesearch to index all of the labs/tools/*.git repos from Gerrit. I think that doing the same for the gitlab repos would look something like conf["repos"].update(wmf_gitlab_group_projects("toolforge-repos/")) in the same general config area. I'll offer up a patch for that and we can see what the maintainers think.

Change #1060493 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[labs/codesearch@master] config: Index https://gitlab.wikimedia.org/toolforge-repos/*

https://gerrit.wikimedia.org/r/1060493

Change #1060493 merged by jenkins-bot:

[labs/codesearch@master] config: Index https://gitlab.wikimedia.org/toolforge-repos/*

https://gerrit.wikimedia.org/r/1060493