All Wikimedia projects inaccessible on 2023-09-12 for several minutes
Closed, ResolvedPublicBUG REPORT
Actions

Assigned To

None

Authored By

	Wellverywell
	Sep 12 2023, 4:54 PM

Description

What happened?:
As it can be seen on Wikimedia Status (and according to reports e.g. on Russian Wikipedia Discord), there were two large outages today at 12:15-12:30 and 16:05-16:20 UTC, producing more than 12.5k errors per second at peak.

Both outages happened after an extraordinarily large amount of requests (260k at 12:20 and 370k at 15:55), could it be some kind of DDOS?

Event Timeline

Wellverywell created this task.Sep 12 2023, 4:54 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 12 2023, 4:54 PM

Wellverywell updated the task description. (Show Details)Sep 12 2023, 4:55 PM

Aklapper renamed this task from All Wikimedia projects were inaccessible today 2 times for several minutes to All Wikimedia projects inaccessible on 2023-09-12 for several minutes.Sep 12 2023, 4:57 PM

Aklapper added a project: SRE.

Wellverywell updated the task description. (Show Details)Sep 12 2023, 4:58 PM

Fabfur subscribed.Sep 12 2023, 4:58 PM

Novem_Linguae subscribed.Sep 12 2023, 4:58 PM

We believe this is resolved now. In general we have monitoring to detect outages of that level and update IRC (#wikimedia-tech on libera.chat) and/or wikimediastatus.net for larger issues, so creating tasks is not necessary.

All Wikimedia projects inaccessible on 2023-09-12 for several minutesClosed, ResolvedPublicBUG REPORTActions

Description

Event Timeline

All Wikimedia projects inaccessible on 2023-09-12 for several minutes
Closed, ResolvedPublicBUG REPORT
Actions