Page MenuHomePhabricator

"There was a problem during the HTTP request: 500 Internal Server Error" errors on the authentication channel
Closed, DeclinedPublicPRODUCTION ERROR

Description

Error
normalized_message
There was a problem during the HTTP request: {parameter1} {parameter2}
exception.trace
Impact

Minor, 9 events in a week.

Notes

Whatever is logging these should provide more information (at least the URL of the request that failed). The message is probably from the Status object returned by MwHttpRequest.

Event Timeline

That's the http-bad-status message from here: https://gerrit.wikimedia.org/g/mediawiki/core/+/38be27045d2f0e94b09c33de353959aaf39f1a7c/includes/http/MWHttpRequest.php#491

The error message indicates that it went through getPsr3MessageAndContext, and it's logged as an ERROR on the authentication channel, which narrows down what could be logging it.

In fact, I can't find any place in all of our codebases where that particular combination of logging is used. Could it be logged from some private config code?

Probably IPReputation? Authentication providers are automatically injected with an authentication logger.

Oh, I eliminated that because the file also assigns $this->logger = LoggerFactory::getInstance( 'IPReputation' ); here, but I guess that gets overridden later! That must be it then.

Yeah, in AbstractAuthenticationProvider::init(). I assume that's unintentional. @kostajh FYI.

Probably caused by T375006—in the last two weeks, the only HTTP 500 errors returned by ipoid are caused by these timeouts.

mszabo triaged this task as Low priority.

Closing this per the resolution of T375006. Please feel free to reopen if the volume increases.

Thanks for looking into it! I think it would still be good to improve the logging (either move it to a dedicated channel, or add some sort of prefix) - the message is not very helpful as it is.

Change #1118513 had a related patch set uploaded (by Máté Szabó; author: Máté Szabó):

[mediawiki/extensions/IPReputation@master] auth: Use correct logging channel

https://gerrit.wikimedia.org/r/1118513

Change #1118555 had a related patch set uploaded (by Bartosz Dziewoński; author: Bartosz Dziewoński):

[mediawiki/extensions/IPReputation@master] Add stack trace to log message with unclear source

https://gerrit.wikimedia.org/r/1118555

Change #1118556 had a related patch set uploaded (by Bartosz Dziewoński; author: Bartosz Dziewoński):

[mediawiki/extensions/WikimediaEvents@master] Add stack trace to log message with unclear source

https://gerrit.wikimedia.org/r/1118556

Change #1118513 merged by jenkins-bot:

[mediawiki/extensions/IPReputation@master] auth: Use correct logging channel

https://gerrit.wikimedia.org/r/1118513

Change #1118555 merged by jenkins-bot:

[mediawiki/extensions/IPReputation@master] Add stack trace to log message with unclear source

https://gerrit.wikimedia.org/r/1118555

Change #1118556 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Add stack trace to log message with unclear source

https://gerrit.wikimedia.org/r/1118556