Process the Adyen audit file like the other audit files are processed
Closed, ResolvedPublic4 Estimated Story Points
Actions

Description

Previously, we hadn't actually been using Adyen reports as audit files - just finding dangling auths and charging them. If our IPN somehow missed a notification, or if the queue was down when the donor hit our site, we'd never record the donation. We should process Adyen audit files like the others, merging data from the report with data from the logs to reconstruct any donation that may have been missed.

Details

Subject	Repo	Branch	Lines +/-
Tests for Adyen audit parser	wikimedia/fundraising/crm	master	+196 -0
Enable adyen_audit in wmff build	wikimedia/fundraising/civicrm-buildkit	master	+1 -0
Adyen audit processor	wikimedia/fundraising/crm	master	+138 -2
Adyen audit processor	wikimedia/fundraising/SmashPig	master	+461 -158
Log Adyen donation details before redirect	mediawiki/extensions/DonationInterface	master	+6 -5
Rename get_recon_file_date function	wikimedia/fundraising/crm	master	+19 -12

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	None	T93302 Big English Fundraiser - December
Resolved	None	T90748 [epic] Get Adyen back up
Resolved	None	T118202 [epic] Adyen campaign ready
Resolved	• cwdent	T121129 Process the Adyen audit file like the other audit files are processed

Event Timeline

Ejegg created this task.Dec 10 2015, 6:50 PM

Ejegg raised the priority of this task from to Needs Triage.

Ejegg updated the task description. (Show Details)

Ejegg added projects: FR-Adyen, FR-Smashpig, Fundraising-Backlog.

Ejegg subscribed.

Restricted Application added subscribers: StudiesWorld, Aklapper. · View Herald TranscriptDec 10 2015, 6:50 PM

Ejegg added a parent task: T118202: [epic] Adyen campaign ready.Dec 10 2015, 6:56 PM

• DStrine moved this task from Triage to Sprint +1 on the Fundraising-Backlog board.Dec 15 2015, 8:20 PM

• DStrine set Security to None.Dec 29 2015, 8:26 PM

• DStrine edited a custom field.

• atgo triaged this task as High priority.Jan 20 2016, 10:29 PM

• DStrine moved this task from Sprint +1 to Current Sprint & Completed in Q3 1516 on the Fundraising-Backlog board.Jan 20 2016, 11:42 PM

• DStrine added a project: Fundraising Sprint Bloodletting 2016.Jan 20 2016, 11:51 PM

Ejegg claimed this task.Feb 1 2016, 9:50 PM

Ejegg moved this task from Backlog to Doing on the Fundraising Sprint Bloodletting 2016 board.

Looks like we need to subscribe to a second report to see chargebacks. There's no type for them on the Payments Accounting Report we're using to clear uncaptured authorizations, but they are one of the journal types for Settlement Detail Report.

• DStrine added a project: Fundraising Sprint Cat Herding.Feb 3 2016, 11:40 PM

Ejegg removed Ejegg as the assignee of this task.Feb 4 2016, 12:07 AM

• cwdent claimed this task.Feb 10 2016, 1:51 AM

Let me know if you need any updating on current status of the processing refunds into civi (not much to say - just call mark_refund)

The current audit parser built in to SmashPig does just about nothing. It was capturing all the un-captured authorizations, and nothing else. Now that we want to leave un-captured authorizations for review, it shouldn't even do that.

Suggestion: build an audit parser in the style of AstroPay and Worldpay which runs under CRM. The initial version can satisfy this ticket by parsing out chargebacks and refunds only. I think that means we can stub out the log parsing functions. Later we can expand it to parse donation details out of logs and confirm any new donations we missed due to listener or queue outage.

Change 270353 had a related patch set uploaded (by Ejegg):
Log Adyen donation details before redirect

https://gerrit.wikimedia.org/r/270353

gerritbot added a project: Patch-For-Review.Feb 12 2016, 8:34 PM

Ejegg moved this task from Backlog to Doing on the Fundraising Sprint Cat Herding board.Feb 12 2016, 10:11 PM

Change 270416 had a related patch set uploaded (by Ejegg):
WIP Adyen audit processor

https://gerrit.wikimedia.org/r/270416

• DStrine added a project: Fundraising Sprint Dirt Farming.Feb 17 2016, 11:49 PM

• cwdent moved this task from Backlog to Doing on the Fundraising Sprint Dirt Farming board.Feb 18 2016, 12:05 AM

Change 271450 had a related patch set uploaded (by Ejegg):
Rename get_recon_file_date function

https://gerrit.wikimedia.org/r/271450

Change 271450 merged by Cdentinger:
Rename get_recon_file_date function

https://gerrit.wikimedia.org/r/271450

Change 270353 merged by jenkins-bot:
Log Adyen donation details before redirect

https://gerrit.wikimedia.org/r/270353

ReleaseTaggerBot added a project: MW-1.27-release (WMF-deploy-2016-03-01_(1.27.0-wmf.15)).Feb 18 2016, 5:00 PM

Change 270457 had a related patch set uploaded (by Ejegg):
Adyen audit processor

https://gerrit.wikimedia.org/r/270457

Change 271937 had a related patch set uploaded (by Ejegg):
Enable adyen_audit in wmff build

https://gerrit.wikimedia.org/r/271937

Change 271938 had a related patch set uploaded (by Ejegg):
Tests for Adyen audit parser

https://gerrit.wikimedia.org/r/271938

Ejegg moved this task from Doing to Review on the Fundraising Sprint Dirt Farming board.Feb 20 2016, 12:18 AM

Ejegg renamed this task from Process refunds in Adyen audit file to Process the Adyen audit file like the other audit files are processed.Feb 20 2016, 12:22 AM

Ejegg updated the task description. (Show Details)

Ejegg changed the point value for this task from 2 to 4.

Ejegg added a subscriber: • cwdent.

Change 270457 merged by jenkins-bot:
Adyen audit processor

https://gerrit.wikimedia.org/r/270457

Change 270416 merged by jenkins-bot:
Adyen audit processor

https://gerrit.wikimedia.org/r/270416

Change 271937 merged by Ejegg:
Enable adyen_audit in wmff build

https://gerrit.wikimedia.org/r/271937

Ejegg moved this task from Review to Pending Deployment on the Fundraising Sprint Dirt Farming board.Feb 20 2016, 1:30 AM

Change 271938 merged by jenkins-bot:
Tests for Adyen audit parser

https://gerrit.wikimedia.org/r/271938