Page MenuHomePhabricator

Process Adyen IPN messages in parallel (improve TY delivery times)
Open, Needs TriagePublic

Description

We currently put all Adyen IPN messages onto the same queue as they come in, then process them one at a time. This process takes a few seconds for each one since we make a couple of API calls. Unfortunately, that's not fast enough to keep up with our generous donors when we set Adyen up to receive half of the traffic from US banners. This morning's test saw a constantly-growing Adyen queue, which only started dropping when we turned banners off. Donor TY mails were up to 1 hr late after three hours of the test.

Event Timeline

Ejegg created this task.Sep 18 2019, 7:00 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 18 2019, 7:00 PM
DStrine renamed this task from Process Adyen IPN messages in parallel to Process Adyen IPN messages in parallel (improve TY delivery times).May 6 2020, 3:54 PM
DStrine moved this task from Q1 (July-Sept) 2020-2021 to Triage on the Fundraising-Backlog board.
MBeat33 added a subscriber: MBeat33.May 6 2020, 3:55 PM
Ejegg added a comment.May 6 2020, 3:56 PM

It would be nice to have a generalized way to multiplex any of the queues defined in our config yaml files.

I'm concerned that with scaling up transaction volume (if we go w/Adyen for EN6C cards for example) we might see an increase in donors asking if we received their successful donations. If we see that in Q2 I might ask to prioritize this task higher.