Page MenuHomePhabricator

iframe error / error ref #s before entering card #s
Closed, ResolvedPublic

Description

We're seeing a batch of errors at the front of the queue where donors either report the iframe not opening, or they receive an error ref # before entering their card #. Triage underway to get browser details, and I'll add more details as we receive them, but this feels spiky so I'm starting to document here.

Possibly related, the Ingenico console is timing out for multiple DS agents. These errors are piling up front of queue I'm thinking this might need to be UBN - we can't triage or invite donors to retry w/out Ingenico.

ZD ticketerror refcommentnotes
879335
879332
879328
87932796106539.16
879324
879321
879320
879314
879309
879304
879303
879296
879293
879292
879290
879279
879277
879270
87924196095555.9" I'm not able to get past the initial information entry page"
879240"the website failed to load the page to enter my card information"
879227"I keep getting the " error processing your request" message, before I enter credit card information."
879221"Nothing appeared on screen to enter card information"
879219"when I select which type of card I am using, it just says error"
879218"site won't let me enter my visa information. It has a error message before I even put in my card number"
879216"Can not donate on site"
879185" I filled out all the information, clicked the box indicating my wish to use my Visa card, and nothing happened--no place to enter my card number, expiration date, etc."
879156"it never gets to the point of entering my credit card info. after choosing Mastercard."
879118"when I try to donate on my phone (Safari) via Credit Card, nothing shows up to input my information. "screenshot, no ref #
87909696076125.7" am getting this error message regardless of which credit card method I select"screenshot

Event Timeline

I was able to load the iframe on firefox, chrome and safari. There was a bit of a slow load but nothing out of the ordinary. I was able to make a donation on firefox. I didn't see any errors

DStrine triaged this task as Unbreak Now! priority.Dec 3 2020, 6:44 PM
DStrine updated the task description. (Show Details)

@MBeat33 and @EMartin this looks like ingenico getting a little wonky for a short period of time. We can't replicate right now and I heard the console came back up right around that time too. Some of the donors here got caught for fraud, probably because they retried a few times. Please let us know if you continue to see reports.

@MBeat33 I was on the phone with Ingenico and they acknowledge they have an issue in flight right now. Donors may experience a timeout or SLL error and it would be impacting the console as well. They will advise when they have diagnosed the problem. It appears intermittent but it is being reported by several merchants. I have shared your examples above as well. Thanks

For the ones with ct_ids, they seem to be getting the redirect to the iframe just fine, so we're not seeing any errors in the server<->server communication. Like with paypal, we're handing them off and they're getting an issue on the hosted page.

Maybe whatever is breaking the console is also breaking the hosted checkout pages?

Thanks @Ejegg. After checking w/ Evelyn, we're inviting these donors to retry, hopefully they get through on retry.

Ingenic has routed us out of their Miaimi data center they report an issue with their Internet Service Provider there. We are monitoring issues with DS to see if this quiets things down.

Status as of 12.4.2020 7am PT: From Ingenico: “Connection issues for some merchants to Miami. We are experiencing issues with the Internet Service Provider in Miami Datacenter. Currently we are processing in AMS datacenter (switched at 19:35 hrs. Dec 3rd) 2020-12-04 07:00 – Traffic was switched to Amsterdam on 19:35 (Dec 3rd). As there currently is no merchant impact, it was decided to leave traffic pointing to AMS until normal working hours to give the Service Provider time to work on the fault.”