1.34.0-wmf.21 cause Graphoid service check to fail due to 403 from mediawiki.org
Closed, ResolvedPublicPRODUCTION ERROR
Actions

Description

Error

[16:45:43] <logmsgbot> !log hashar@deploy1001 rebuilt and synchronized wikiversions files: group0 to 1.34.0-wmf.21 - T220746

message

PROBLEM - graphoid endpoints health on scb2006 is CRITICAL:
/{domain}/v1/{format}/{title}/{revid}/{id} (retrieve PNG from mediawiki.org) is CRITICAL:
Test retrieve PNG from mediawiki.org returned the unexpected status 400 (expecting: 200) https://wikitech.wikimedia.org/wiki/Services/Monitoring/graphoid

Impact

That sounds bad for Graphoid

Notes

Happened immediately after promoting 1.34.0-wmf.21 to group0 and hence www.mediawiki.org

There are a few 403 errors showing up for the scb hosts in logstash.

Details

Stack Trace

N/A

Subject	Repo	Branch	Lines +/-
Fix array vs object access	mediawiki/extensions/Graph	wmf/1.34.0-wmf.21	+2 -2
Fix array vs object access	mediawiki/extensions/Graph	master	+2 -2
Promote testwiki to 1.34.0-wmf.21	operations/mediawiki-config	master	+1 -1

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved	Release	hashar	T220746 1.34.0-wmf.21 deployment blockers
		Resolved	PRODUCTION ERROR	• Catrope	T231894 1.34.0-wmf.21 cause Graphoid service check to fail due to 403 from mediawiki.org

Event Timeline

hashar created this task.Sep 3 2019, 2:59 PM

Restricted Application removed a project: Patch-For-Review. · View Herald TranscriptSep 3 2019, 2:59 PM

Train blockers are UBN

Restricted Application added a subscriber: Liuxinyu970226. · View Herald TranscriptSep 3 2019, 3:00 PM

hashar mentioned this in T220746: 1.34.0-wmf.21 deployment blockers.Sep 3 2019, 3:01 PM

Change 534173 had a related patch set uploaded (by Hashar; owner: Hashar):
[operations/mediawiki-config@master] Promote testwiki to 1.34.0-wmf.21

https://gerrit.wikimedia.org/r/534173

Change 534173 merged by jenkins-bot:
[operations/mediawiki-config@master] Promote testwiki to 1.34.0-wmf.21

https://gerrit.wikimedia.org/r/534173

Mentioned in SAL (#wikimedia-operations) [2019-09-03T15:07:14Z] <hashar@deploy1001> rebuilt and synchronized wikiversions files: testwiki 1.34.0-wmf.21 for T231894 - T220746

• mobrovac edited projects, added MediaWiki-extensions-Graph, Platform Team Workboards (Clinic Duty Team); removed Patch-For-Review, Graphoid.Sep 3 2019, 3:12 PM

Change 534174 had a related patch set uploaded (by Catrope; owner: Catrope):
[mediawiki/extensions/Graph@master] Fix array vs object access

https://gerrit.wikimedia.org/r/534174

gerritbot added a project: Patch-For-Review.Sep 3 2019, 3:18 PM

Change 534174 merged by jenkins-bot:
[mediawiki/extensions/Graph@master] Fix array vs object access

https://gerrit.wikimedia.org/r/534174

Change 534188 had a related patch set uploaded (by Catrope; owner: Catrope):
[mediawiki/extensions/Graph@wmf/1.34.0-wmf.21] Fix array vs object access

https://gerrit.wikimedia.org/r/534188

ReleaseTaggerBot added a project: MW-1.34-notes (1.34.0-wmf.22; 2019-09-10).Sep 3 2019, 4:00 PM

• Catrope mentioned this in rEGRAd0caddbd29b5: Fix array vs object access.Sep 3 2019, 4:07 PM

Change 534188 merged by Catrope:
[mediawiki/extensions/Graph@wmf/1.34.0-wmf.21] Fix array vs object access

https://gerrit.wikimedia.org/r/534188

• Catrope mentioned this in rEGRA349fcc5fbd88: Fix array vs object access.Sep 3 2019, 4:25 PM

Mentioned in SAL (#wikimedia-operations) [2019-09-03T16:35:06Z] <catrope@deploy1001> Synchronized php-1.34.0-wmf.21/extensions/Graph/includes/ApiGraph.php: T231894 (duration: 00m 55s)

ReleaseTaggerBot edited projects, added MW-1.34-notes (1.34.0-wmf.21; 2019-09-03); removed MW-1.34-notes (1.34.0-wmf.22; 2019-09-10).Sep 3 2019, 5:00 PM

This is theoretically now fixed.

Looks indeed solved :] Thank you!

[batch] remove patch for review tag from resolved tasks

1.34.0-wmf.21 cause Graphoid service check to fail due to 403 from mediawiki.orgClosed, ResolvedPublicPRODUCTION ERRORActions