Maniphest T195563

Error: 503, Backend fetch failed
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	RazeSoldier
	May 25 2018, 9:28 AM

Description

Mediawiki.org, enwiki and zhwiki can not access, there may be more wikis that cannot be accessed.
Error message:

Request from 120.229.35.146 via cp4030 cp4030, Varnish XID 344497377
Error: 503, Backend fetch failed at Fri, 25 May 2018 09:25:00 GMT

Screenshot:

QQ图片20180525172556.png (768×1 px, 111 KB)

Related Objects

Mentioned In: T299160: ATS 502 on uploading non-small files

Event Timeline

RazeSoldier created this task.May 25 2018, 9:28 AM

Restricted Application added a project: SRE. · View Herald TranscriptMay 25 2018, 9:28 AM

Restricted Application added subscribers: Stang, Aklapper. · View Herald Transcript

Can you retry, it should be solved now or shortly (or may need a refresh of your browser)?

We are on it

In T195563#4230935, @jcrespo wrote:

Can you retry, it should be solved now or shortly (or may need a refresh of your browser)?

Yes, I retry but this problem still exists.

It seems that I can visit wikitech but other WMF‘s websites cannot access.

I can visit now, but I don't know what happened.

Not your fault, issues with connectivity on certain regions on the world- a datacenter was disabled to workaround it. Thank you for the quick report, it helped!

Our San Francisco datacenter is linked to our infrastructure by 2 links.
1 link had a planned maintenance, the other had an outage at the wrong time.
as soon as we noticed the issue, we disabled that datacenter, redirecting the users to a functional datacenter.
The links are back to a healthy state, and will re-enable that datacenter shortly.
We identified short and long term solutions to increase resiliency and reduce the risk of the issue happening again.

Thank you for reporting the issue.

In T195563#4231327, @ayounsi wrote:

as soon as we noticed the issue, we disabled that datacenter, redirecting the users to a functional datacenter.

In this case, is the disabling action automatic or manual?

Manual.
It would be automatic in an ideal world, but not enough resources to work on that.

• Vvjjkkii renamed this task from Error: 503, Backend fetch failed to 0acaaaaaaa.Jul 1 2018, 1:08 AM

• Vvjjkkii reopened this task as Open.

• Vvjjkkii removed ayounsi as the assignee of this task.

• Vvjjkkii triaged this task as High priority.

• Vvjjkkii added projects: CheckUser, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), Tamil-Sites, Gamepress, Hashtags, Jade, KartoEditor, Language-2018-Apr-June, New-Editor-Experiences, Mail, TCB-Team (now WMDE-TechWish).

• Vvjjkkii updated the task description. (Show Details)

• Vvjjkkii removed a subscriber: Aklapper.

• ema renamed this task from 0acaaaaaaa to Error: 503, Backend fetch failed.Jul 2 2018, 9:34 AM

• ema closed this task as Resolved.

• ema assigned this task to ayounsi.

• ema updated the task description. (Show Details)

• ema removed projects: TCB-Team (now WMDE-TechWish), Mail, New-Editor-Experiences, Language-2018-Apr-June, KartoEditor, Jade, Hashtags, Gamepress, Tamil-Sites, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), CheckUser.Jul 2 2018, 9:36 AM

• ema raised the priority of this task from High to Needs Triage.Jul 2 2018, 10:04 AM

• ema added subscribers: Aklapper, gerritbot.

Stang unsubscribed.Nov 13 2021, 10:57 PM

I get this error message, while the file uploaded fine. Very annoying.

Request from 2.7.118.246 via cp3064 cp3064, Varnish XID 322415563
Error: 503, Backend fetch failed at Sun, 09 Jan 2022 13:47:48 GMT

https://commons.wikimedia.org/wiki/File:Troismousquetaires_51_dumas.mp3 26 MB file, upload-by-url from IA

This happens regularly for files from 25 to 35 MB.

Please open a new task. These will be separate issues.

Platonides mentioned this in T299160: ATS 502 on uploading non-small files.Jan 13 2022, 7:37 PM

Error: 503, Backend fetch failedClosed, ResolvedPublicActions

Description

Related Objects

Event Timeline

Error: 503, Backend fetch failed
Closed, ResolvedPublic
Actions