Maniphest T426484

Add proxy support to GitHub actions
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Xqt
	May 16 2026, 5:44 AM

Project Tags

Referenced Files

None

Subscribers

pywikibot-bugs-list

Description

Pywikibot runs a relatively large set of post-merge tests via GitHub Actions. Some of these tests use Beta Cluster wikis as their target for end-to-end testing of various features especially upcoming changes of new MW versions.

GitHub Actions uses Microsoft Azure to host it's runners. There are over 5000 (!) IP ranges listed at https://api.github.com/meta that GitHub Actions might make requests from. Due to unwanted crawlers, some of the IP addresses used by GitHub Actions have blocked and lead to http response 403 (see T399415).

So solve this problem, a proxy can be used. It’s usage is already available through requests package:
https://www.mediawiki.org/wiki/Manual:Pywikibot/Installation
https://requests.readthedocs.io/en/latest/user/advanced/#proxies
T399485#11011491

This might also increase the WM rate limits

Details

Related Changes in Gerrit:

	Subject	Author	Repo	Branch	Lines +/-
	[tests] Run WMCS SOCKS setup as bash in doctest	Xqt	pywikibot/core	master	+1 -0
	[tests] Add SOCKS proxy support to several GutHub actions tests	Xqt	pywikibot/core	master	+113 -23
	[tests] Add SOCKS proxy support to pywikibot-ci	Xqt	pywikibot/core	master	+39 -0

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
					Restricted Task
		Resolved	BUG REPORT	bd808	T399329 2025-07-11 traffic overload
		Resolved		Xqt	T399415 Unable to generate family for wpbeta:zh with github action (ClientError: (403) Request forbidden)
		Resolved	BUG REPORT	Xqt	T399367 CI tests fails with TimeoutError in _json_loads when userinfo is retrieved
		Open	Feature	Xqt	T399485 Find a way for pywikibot GitHub Actions to avoid IP range blocks of Microsoft Azure hosted runners
		Resolved		Xqt	T416357 Wikimedia Hackathon Northwestern Europe 2026 (PWB)
		Resolved		Xqt	T419127 Pywikibot-test is active on non-test Wikipedias
		Resolved	BUG REPORT	Xqt	T414170 All Github actions tests fails due to 429 status code
		Resolved		Xqt	T426484 Add proxy support to GitHub actions

Event Timeline

Xqt created this task.May 16 2026, 5:44 AM

Restricted Application added subscribers: pywikibot-bugs-list, • Aklapper. · View Herald TranscriptMay 16 2026, 5:44 AM

Xqt triaged this task as Medium priority.May 16 2026, 5:45 AM

Xqt added parent tasks: T414170: All Github actions tests fails due to 429 status code, T399485: Find a way for pywikibot GitHub Actions to avoid IP range blocks of Microsoft Azure hosted runners.

Change #1287995 had a related patch set uploaded (by Xqt; author: Xqt):

[pywikibot/core@master] [tests] Add SOCKS proxy support to pywikibot-ci

https://gerrit.wikimedia.org/r/1287995

gerritbot added a project: Patch-For-Review.May 16 2026, 1:17 PM

Change #1287995 merged by Xqt:

[pywikibot/core@master] [tests] Add SOCKS proxy support to pywikibot-ci

https://gerrit.wikimedia.org/r/1287995

Maintenance_bot removed a project: Patch-For-Review.May 16 2026, 1:30 PM

Xqt updated the task description. (Show Details)May 16 2026, 1:49 PM

Change #1287996 had a related patch set uploaded (by Xqt; author: Xqt):

[pywikibot/core@master] [tests] Add SOCKS proxy support to several GutHub actions tests

https://gerrit.wikimedia.org/r/1287996

gerritbot added a project: Patch-For-Review.May 16 2026, 2:35 PM

Change #1287996 merged by Xqt:

[pywikibot/core@master] [tests] Add SOCKS proxy support to several GutHub actions tests

https://gerrit.wikimedia.org/r/1287996

Change #1287998 had a related patch set uploaded (by Xqt; author: Xqt):

[pywikibot/core@master] [tests] Run WMCS SOCKS setup as bash in doctest

https://gerrit.wikimedia.org/r/1287998

Change #1287998 merged by Xqt:

[pywikibot/core@master] [tests] Run WMCS SOCKS setup as bash in doctest

https://gerrit.wikimedia.org/r/1287998

Xqt closed this task as Resolved.May 16 2026, 3:23 PM

Xqt mentioned this in T414170: All Github actions tests fails due to 429 status code.

Xqt added a subscriber: bd808.

Xqt mentioned this in T414173: All github action tests of Pywikibot fails due to 429 status code (TOO MANY REQUESTS).May 16 2026, 3:26 PM

Xqt mentioned this in T399415: Unable to generate family for wpbeta:zh with github action (ClientError: (403) Request forbidden).

Maintenance_bot removed a project: Patch-For-Review.May 16 2026, 3:30 PM

bd808 awarded a token.May 16 2026, 5:23 PM

Xqt added a parent task: T419127: Pywikibot-test is active on non-test Wikipedias.May 17 2026, 7:37 AM

Xqt mentioned this in T419127: Pywikibot-test is active on non-test Wikipedias.May 17 2026, 7:40 AM