Page MenuHomePhabricator

Adyen daily audit file check - how to process transactions >12k
Open, MediumPublic

Description

I manually settled two Adyen donations recently, and neither was picked up by the daily audit file. @XenoRyet suggested putting them here for a wellness check.

CIDPSP referencedate settleddate to Civi
1241037KC2R2JH9K83BKTF3Jul 7, 2025, 11:59:02not yet
23397927HG8N5PZSHDPSG435Jun 30, 2025, 10:29:32*June 30th, 2025 9:13

#1 is unusual in that there are no donor details at Adyen, but nothing at $50k has come in to Civi this week

#2 was a little confusing, as neither Rosie nor I saw this in Civi on July 1 (and she confirmed the record was created on 07/02/2025) and the TY email was sent July 2nd

This Task is basically just to ask whether the Adyen daily audit is still catching manual settles, and also to confirm the timeframe for when it runs and when we can expect the manual settles to reach Civi.

Details

Related Changes in Gerrit:

Event Timeline

@mbeattie. I entered this task https://phabricator.wikimedia.org/T399033 as #1 was a donation made by a donor using PaybyLink at Adyen on our core account but I do not see it in Civi.

@EMartin I think the Adyen weekly audit on Friday should catch it into Civi, whether or not it comes with enough PII to merge into CID 241037

MBeat33 triaged this task as High priority.Jul 14 2025, 1:06 PM

Hi Fr-Tech, the weekly audit file did not pick up this major gift. Could someone please manually import it to Civi? Thank you.

PSP reference: LSDHB27JGXR2MRF3

Do we know why it was missed as we'd like to use this manual facility for large gifts again in the future?

Change #1170020 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/crm@master] Loosen Adyen audit regex

https://gerrit.wikimedia.org/r/1170020

I dug into the audit files and transaction LSDHB27JGXR2MRF3 appears in the audit files and payment listener

payments-listener-adyen-20250708.gz:Jul  7 15:59:07 SmashPig-Adyen: SPCID-1064808375 | (RawData) {"live":"true","notificationItems":[{"NotificationRequestItem":{"additionalData":{"paymentLinkId":"PL4771A682C5CBDB272","bookingDate":"2025-07-07T17:59:02Z"},"amount":{"currency":"USD","value":5000000},"eventCode":"CAPTURE","eventDate":"2025-07-07T17:57:34+02:00","merchantAccountCode":"WikimediaDonations","merchantReference":"WikimediaFoundation","originalReference":"KC2R2JH9K83BKTF3","paymentMethod":"mc","pspReference":"LSDHB27JGXR2MRF3","reason":"","success":"true"}}]} |  |
  • payments_accounting_report_2025_07_07.csv
  • payments-listener-adyen-20250702.gz
  • payments-listener-adyen-20250708.gz
  • settlement_detail_report_batch_1118.csv
  • settlement_detail_report_2025-07-10.csv

However, I don't see anything in the incoming data that would allow us to import it to a CiviCRM contact. This is a process I'm not familiar with but it sounds like you are taking the donation outside of CiviCRM and expecting it to import from the Audit. The problem is the information from Adyen has no contact-identifying information

I CAN find
paymentLinkId":"PL4771A682C5CBDB272"
"networkTxReference":"MDHYAJOVO0701"
"acquirerReference":"518219683956"
"PaymentAccountReference":"500109JXE8VZDXRGHVICF3S1IPOGO"
"pspReference":"KC2R2JH9K83BKTF3"

On settlement
"originalReference":"KC2R2JH9K83BKTF3"
"pspReference":"LSDHB27JGXR2MRF3"

Am I missing something that links back to contact information? Otherwise I think it would be necessary for someone to enter the donation through the CiviCRM UI or to pass on to Melanie to import it - it might be that the gateway txn fields can only be entered via import

Other than looking at the above there were quite a few audit files there & I ran the audit processing quite a few times & eventually they all seemed to process away to nothing. I'm not quite sure why that was but it might be that some back log caused the now you don't see it now you do reported in 2. I will try to keep an eye on this & check in with @Ejegg next week when he is back

I did put up one patch just to make the incoming log list a bit less confusing https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/1170020

Change #1170020 merged by jenkins-bot:

[wikimedia/fundraising/crm@master] Loosen Adyen audit regex

https://gerrit.wikimedia.org/r/1170020

@MDemosWMF Can we get this transaction in civi from the above info? Rosie @RLewis will know which CID/contact to apply it to. In the future we should create these links and require the USER info. That is doable in the PaybyLink feature.

It's probably doing a test of PaybyLink with that info to see what happens / what we get from Adyen

@EMartin @RLewis Sure thing - I will need the following information:

  • CID
  • Financial type
  • Total: 50K
  • Date: July 7th
  • Payment method
  • Thank you date: Will need to confirm w/ @RLewis if an email TY should be sent upon entry
  • Fund
  • Channel
  • Gift Type
  • Appeal
  • Gateway

If any other information needs to be captured for online transactions please let me know.

@MDemosWMF let me know if you need anything else.

CID -
241037
Financial type -
Total: 50K
Date: July 7th
Payment method - credit card
Thank you date: Will need to confirm w/ @RLewis if an email TY should be sent upon entry - Sarah has created a pdf version so we're good on this
Fund - Unrestricted - General
Channel - Direct Solicitation
Gift Type - Foundation Gift
Appeal MGGO25
Gateway - Ayden

@RLewis Thanks! I've entered this on CID 241037. Let me know if there is anything missing!

@EMartin if we could come up with a special URL parameter to allow for larger donations on payments-wiki, would that work? That way would involve a lot less code and get the donation into Civi a lot faster than trying to connect pay-by-link payments.

@Ejegg Sure! Can we share a link to this URL parameter with donors? The 12k block we have on our systems thwarts the larger donations like this. Are you saying that that wouldn't exist with this parameter?

Yes @EMartin, I envision it being a parameter we can share with donors, which would have a special higher limit.

That would be great. Do we have to ask FRTech for it each time? It would be great to have it on demand for such cases of a donor in waiting who wants to give now. Interesting that we can do this.

It will take some coding to create this variant, then it will be available for use whenever you want it.

EMartin renamed this task from Adyen daily audit file check to Adyen daily audit file check - how to process transactions >12k.Jul 29 2025, 8:10 PM