Page MenuHomePhabricator

Outdated link to User-Agent Policy in Varnish 403 and 429 responses
Closed, ResolvedPublicBUG REPORT

Description

The link provided for "forbidden connections" is outdated: https://meta.wikimedia.org/wiki/User-Agent_policy (it is now a soft-redirect from Meta-wiki to Governance-wiki).

The specific message is:
Failed to open stream: HTTP request failed! HTTP/1.1 403 Forbidden. Please comply with the User-Agent policy: https://meta.wikimedia.org/wiki/User-Agent_policy

The correct URL is: https://foundation.wikimedia.org/wiki/Policy:Wikimedia_Foundation_User-Agent_Policy

(Original user bug-report)

Event Timeline

bd808 subscribed.
$ git grep https://meta.wikimedia.org/wiki/User-Agent_policy
modules/profile/files/wmcs/services/maintain_dbusers/maintain_dbusers.py:    # https://meta.wikimedia.org/wiki/User-Agent_policy
modules/varnish/templates/misc-frontend.inc.vcl.erb:            return (synth(429, "Too many requests. Please comply with the User-Agent policy to get a higher rate limit: https://meta.wikimedia.org/wiki/User-Agent_policy"));
modules/varnish/templates/text-frontend.inc.vcl.erb:            return (synth(403, "Scripted requests from your IP have been blocked, please see https://meta.wikimedia.org/wiki/User-Agent_policy. In case of further questions, please contact noc@wikimedia.org."));
modules/varnish/templates/upload-frontend.inc.vcl.erb:                return (synth(429, "Too many requests. Please comply with the User-Agent policy to get a higher rate limit: https://meta.wikimedia.org/wiki/User-Agent_policy"));
modules/varnish/templates/upload-frontend.inc.vcl.erb:            return (synth(403, "Forbidden. Please comply with the User-Agent policy: https://meta.wikimedia.org/wiki/User-Agent_policy"));
modules/varnish/templates/upload-frontend.inc.vcl.erb:            return (synth(403, "Forbidden. Please comply with the User-Agent policy: https://meta.wikimedia.org/wiki/User-Agent_policy"));
modules/varnish/templates/wikimedia-frontend.vcl.erb:            return (synth(403, "Scripted requests from your IP have been blocked, please see https://meta.wikimedia.org/wiki/User-Agent_policy. In case of further questions, please contact noc@wikimedia.org."));
modules/varnish/templates/wikimedia-frontend.vcl.erb:            return (synth(403, "Scripted requests from your IP have been blocked, please see https://meta.wikimedia.org/wiki/User-Agent_policy. In case of further questions, please contact noc@wikimedia.org."));
modules/varnish/templates/wikimedia-frontend.vcl.erb:            return (synth(429, "Scripted requests from your IP have been blocked, please see https://meta.wikimedia.org/wiki/User-Agent_policy. In case of further questions, please contact noc@wikimedia.org."));

Change #1172434 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[operations/puppet@production] wmcs: Update URL in comment in maintain_dbusers.py

https://gerrit.wikimedia.org/r/1172434

Change #1172435 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[operations/puppet@production] varnish: Update User-Agent Policy url in error messages

https://gerrit.wikimedia.org/r/1172435

bd808 renamed this task from Outdated link in message that is sent for forbidden connections to Outdated link to User-Agent Policy in Varnish 403 and 429 responses.Jul 24 2025, 11:50 PM

Change #1172435 merged by BCornwall:

[operations/puppet@production] varnish: Update User-Agent Policy url in error messages

https://gerrit.wikimedia.org/r/1172435

Change #1177479 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] fixup! varnish: Update User-Agent Policy url in error messages

https://gerrit.wikimedia.org/r/1177479

Change #1177483 had a related patch set uploaded (by BryanDavis; author: Bryan Davis):

[operations/puppet@production] varnish: Update User-Agent Policy url in error messages (take 2)

https://gerrit.wikimedia.org/r/1177483

BCornwall changed the task status from Open to In Progress.Aug 11 2025, 7:59 PM
BCornwall triaged this task as Medium priority.
BCornwall moved this task from Backlog to Actively Servicing on the Traffic board.

Change #1177483 abandoned by BryanDavis:

[operations/puppet@production] varnish: Update User-Agent Policy url in error messages (take 2)

Reason:

Duplicate of Iaf97f1b77450fced2979509ec013dd1cc6f0c478

https://gerrit.wikimedia.org/r/1177483

Change #1177479 merged by BCornwall:

[operations/puppet@production] fixup! varnish: Update User-Agent Policy url in error messages

https://gerrit.wikimedia.org/r/1177479

BCornwall subscribed.

Should be all good on the varnish side now.

bd808 claimed this task.
bd808 updated Other Assignee, added: BCornwall.

Yes, but that one doesn't matter in a user facing sense. It was included in my patch stack just to get all of the old URL usage out of ops/puppet. I'll nudge the WMCS folks to merge it.

Change #1172434 merged by Majavah:

[operations/puppet@production] wmcs: Update URL in comment in maintain_dbusers.py

https://gerrit.wikimedia.org/r/1172434