Speed up user agent-related troubleshooting for WDQS
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	bking
	Dec 12 2022, 9:14 PM

Description

We have had 3 WDQS incidents in the last ~3 weeks .

The most impactful outage is documented in T324346 , which was resolved by finding and banning the abusive user agent.

Creating this ticket to:

Determine how we discovered the bad user agent during the 02 December outage
Create/learn how to use a tool, runbook, and/or dashboard that helps identify the most common user agents hitting WDQS.

Related Objects

Mentioned In: T323620: 2022-11-22 WDQS high load incident
T324346: High error rate in WDQS since 2022-12-02 15:00 UTC
Mentioned Here: T324346: High error rate in WDQS since 2022-12-02 15:00 UTC

Event Timeline

bking created this task.Dec 12 2022, 9:14 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptDec 12 2022, 9:14 PM

bking claimed this task.Dec 12 2022, 9:14 PM

bking edited projects, added Discovery-Search (Current work); removed Discovery-Search.

bking mentioned this in T324346: High error rate in WDQS since 2022-12-02 15:00 UTC.

Michael subscribed.Dec 12 2022, 10:37 PM

Lydia_Pintscher added a project: Wikidata-Query-Service.Dec 13 2022, 3:42 PM

Maintenance_bot added a project: Wikidata.Dec 13 2022, 3:45 PM

bking mentioned this in T323620: 2022-11-22 WDQS high load incident.Dec 13 2022, 7:01 PM

MPhamWMF moved this task from Incoming to Current work on the Wikidata-Query-Service board.Dec 19 2022, 4:43 PM

Gehel closed this task as Resolved.Jan 23 2023, 4:15 PM

(If there were any publicly available docs created in context of this task/incident, then I would appreciate if they could be linked here. But I understand if that was not the case for security reasons.)

Speed up user agent-related troubleshooting for WDQSClosed, ResolvedPublicActions

Description

Related Objects

Event Timeline

Speed up user agent-related troubleshooting for WDQS
Closed, ResolvedPublic
Actions