Page MenuHomePhabricator

Investigate timeouts from Adyen Soap listener
Closed, ResolvedPublicBUG REPORT

Description

We've seen about 10 of these intermittently over the past month .

Sample failmail:

FAILMAIL - ALERT: frpig1001 (adyen) SmashPig-Adyen::SPCID-2115706608

A problem has developed in SmashPig -- the available context is shown below. Data objects are excluded for security but may be found in alternative log streams if configured.

NOTE: Additional errors may have occurred this session, but this email will only be sent once. Check log streams for additional errors in this session.

2022-09-05T00:06:53+00:00 [DEBUG] Entering logging context 'SPCID-2115706608'.
2022-09-05T00:06:53+00:00 [INFO] Starting processing for request, configuration view: 'adyen', action: 'listener'
2022-09-05T00:07:53+00:00 [ALERT] Last chance error handler fired. (2) SoapServer::SoapServer(https://ca-live.adyen.com/ca/services/Notification?wsdl): failed to open stream: Connection timed out @ /srv/www/org/wikimedia/listeners/SmashPig/Core/Listeners/SoapListener.php:24

Event Timeline

We got one of these this morning.

Looks like a momentary blip at Adyen's end. We make the call each time the AdyenListener is instantiated according to the code. Interestingly there is a successful Adyen/listener request at the same exact second. I wonder if that has something to do with it.

Here's the full log output for the failed one:

Sep 12 07:00:40 frpig1001 SmashPig-Adyen: SPCID-0316000893 | Last chance error handler fired. (2) SoapServer::SoapServer(https://ca-live.adyen.com/ca/services/Notificati
on?wsdl): failed to open stream: Connection timed out @ /srv/www/org/wikimedia/listeners/SmashPig/Core/Listeners/SoapListener.php:24 | [] |
Sep 12 07:00:40 frpig1001 SmashPig-Adyen: SPCID-0316000893 | Last chance error handler fired. (2) SoapServer::SoapServer(): I/O warning : failed to load external entity
"https://ca-live.adyen.com/ca/services/Notification?wsdl" @ /srv/www/org/wikimedia/listeners/SmashPig/Core/Listeners/SoapListener.php:24 | [] |
Sep 12 07:00:40 frpig1001 SmashPig-Adyen: SPCID-0316000893 | Last chance error handler fired. (8) SoapServer::SoapServer(): failed to discard buffer. No buffer to discar
d @ /srv/www/org/wikimedia/listeners/SmashPig/Core/Listeners/SoapListener.php:24 | [] |
Sep 12 07:00:40 frpig1001 SmashPig-Adyen: SPCID-0316000893 | Fatal error caught by shutdown handler. (1) SOAP-ERROR: Parsing WSDL: Couldn't load from 'https://ca-live.ad
yen.com/ca/services/Notification?wsdl' : failed to load external entity "https://ca-live.adyen.com/ca/services/Notification?wsdl"
Sep 12 07:00:40 frpig1001 SmashPig-Adyen:  @ /srv/www/org/wikimedia/listeners/SmashPig/Core/Listeners/SoapListener.php:24 |  |
Dwisehaupt changed the subtype of this task from "Task" to "Bug Report".Sep 12 2022, 8:23 PM
greg triaged this task as Low priority.Nov 1 2022, 6:14 PM

We've had eleven of these this month already, so it doesn't seem to be going away. Maybe it's time to reach out to Adyen and see if they're aware of anything at their end?

Aklapper added a subscriber: XenoRyet.

@XenoRyet: Please associate at least one active team/codebase project tag with a task, so people can find a task when looking at project workboards or searching for tasks in certain projects. Thanks.

We have gotten hundreds of these today. I thought our smash pig update might have been implicated but rolling back did not stop the tide so back on latest code

Change 941402 had a related patch set uploaded (by Damilare Adedoyin; author: Damilare Adedoyin):

[wikimedia/fundraising/SmashPig@master] Adyen discontinued the NotificationService wsdl URL earlier, this patch adds the actual WSDL directly into our code removing the need for the URL.

https://gerrit.wikimedia.org/r/941402

Change 941402 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] Adyen discontinued the NotificationService wsdl URL earlier, this patch adds the actual WSDL directly into our code removing the need for the URL.

https://gerrit.wikimedia.org/r/941402

Change 941431 had a related patch set uploaded (by Damilare Adedoyin; author: Damilare Adedoyin):

[wikimedia/fundraising/SmashPig@master] Move WSDL to Adyen Directory

https://gerrit.wikimedia.org/r/941431

Change 941431 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] Move WSDL to Adyen Directory

https://gerrit.wikimedia.org/r/941431

XenoRyet set Final Story Points to 4.

Change 941435 had a related patch set uploaded (by Wfan; author: Damilare Adedoyin):

[wikimedia/fundraising/SmashPig@master] remove unwanted config

https://gerrit.wikimedia.org/r/941435

Change 941435 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] remove unwanted config

https://gerrit.wikimedia.org/r/941435