Error message says "%error_body_content%"
Closed, ResolvedPublicBUG REPORT
Actions

Assigned To

Authored By

	Quiddity
	Jul 30 2024, 7:05 PM

Description

Steps that led to the issue:

During Tuesday's train deploy, there was a brief hiccup due to a table change. (@Ladsgroup wrote in the -operations channel "I deployed a schema change on a tiny table but replicas got lagged because […]")
I had just opened a bunch of watchlist links in new tabs.
- One tab showed this broken-looking error message (screenshot/text below) with an HTTP 503
- Two other tabs got the normal error message with an HTTP 502 ("Error. Our servers are currently under maintenance or experiencing a technical problem. Please try again in a few minutes.")

%error_body_content%

If you report this error to the Wikimedia System Administrators, please include the details below.
Request from [IP redacted] via cp1106 cp1106, Varnish XID 844857381
Error: 503, Backend fetch failed at Tue, 30 Jul 2024 18:10:10 GMT

Details

Other Assignee: CDobbins

	Subject	Repo	Branch	Lines +/-
	varnish: fix bug causing %error_body_content% to appear in response body	operations/puppet	production	+29 -2

Customize query in gerrit

Related Objects

Mentioned Here: T372473: Error: 503, Backend fetch failed while editing Commons
T373108: Error publishing edits on wiki pages: "%error_body_content%"

Event Timeline

Quiddity created this task.Jul 30 2024, 7:05 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 30 2024, 7:05 PM

Pppery edited projects, added Traffic; removed MediaWiki-General.Jul 31 2024, 5:22 AM

ssingh updated Other Assignee, added: CDobbins.Jul 31 2024, 4:11 PM

BCornwall subscribed.Aug 1 2024, 4:24 PM

Change #1059123 had a related patch set uploaded (by CDobbins; author: CDobbins):

[operations/puppet@production] varnish: fix bug causing %error_body_content% to appear in response body

https://gerrit.wikimedia.org/r/1059123

gerritbot added a project: Patch-For-Review.Aug 1 2024, 4:53 PM

BCornwall changed the task status from Open to In Progress.Aug 1 2024, 11:53 PM

BCornwall assigned this task to CDobbins.

BCornwall triaged this task as High priority.

BCornwall moved this task from Backlog to Traffic team actively servicing on the Traffic board.

Change #1059123 merged by CDobbins:

[operations/puppet@production] varnish: fix bug causing %error_body_content% to appear in response body

https://gerrit.wikimedia.org/r/1059123

Maintenance_bot removed a project: Patch-For-Review.Aug 6 2024, 2:30 PM

The fix for this was deployed this morning. If this error reappears, please reopen this task or create a new one.

See T372473: Error: 503, Backend fetch failed while editing Commons and T373108: Error publishing edits on wiki pages: "%error_body_content%"

I'm looking into this now. Sorry that this wasn't resolved by the earlier fix.

Closing this now, since a fix was deployed last week and there haven't been any more reports of this happening. Please reopen if this occurs again.

Error message says "%error_body_content%"Closed, ResolvedPublicBUG REPORTActions

Description

Details

Related Objects

Event Timeline

Error message says "%error_body_content%"
Closed, ResolvedPublicBUG REPORT
Actions