Page MenuHomePhabricator

Chariot import - get api access and investigate pulling in DAF (in particular PayPal grants) directly
Closed, ResolvedPublic

Description

We have a couple of issues that would be solved by getting direct access to the Chariot api and pulling in donations directly from there

  1. we are missing information to link incoming PayPal Grants payments to the contributions entered in Civi
  2. @Lars is working with @MDemosWMF on a Chariot import which has some challenges

On discussing with Melanie it seems that DAFs are being consolidated into Chariot so it makes sense to get this working properly

Looking at Chariot they appear to have a mature api https://docs.givechariot.com/api - and if we could get access we can pull in directly. There has been some suggesting that it gets to us via Gravy but from an fr-tech point of view using the Chariot api directly is almost certainly going to be less work with more control / options so I would really like us to, as a first step, get api credentials set up - @EMartin are you OK with requesting Chariot api credentials so we can explore what we can get this way?

Details

Related Changes in Gerrit:
SubjectAuthorRepoBranchLines +/-
Eileenwikimedia/fundraising/crmmaster+8 -5
Eileenwikimedia/fundraising/crmmaster+1 -1
Eileenwikimedia/fundraising/SmashPigmaster+66 -3
Eileenwikimedia/fundraising/crmmaster+33 -7
Eileenwikimedia/fundraising/crmmaster+47 -0
Eileenwikimedia/fundraising/crmmaster+17 -2
Eileenwikimedia/fundraising/SmashPigmaster+12 -12
Eileenwikimedia/fundraising/SmashPigmaster+49 -12
Eileenwikimedia/fundraising/SmashPigmaster+29 -0
Eileenwikimedia/fundraising/SmashPigmaster+11 -1
Eileenwikimedia/fundraising/SmashPigmaster+26 -27
Eileenwikimedia/fundraising/SmashPigmaster+18 -22
Eileenwikimedia/fundraising/SmashPigmaster+13 -16
Eileenwikimedia/fundraising/SmashPigmaster+0 -22
Eileenwikimedia/fundraising/SmashPigmaster+32 -35
Eileenwikimedia/fundraising/SmashPigmaster+0 -18
Eileenwikimedia/fundraising/SmashPigmaster+12 -11
Eileenwikimedia/fundraising/SmashPigmaster+40 -26
Eileenwikimedia/fundraising/SmashPigmaster+4 -6
Eileenwikimedia/fundraising/SmashPigmaster+1 -13
Eileenwikimedia/fundraising/SmashPigmaster+17 -8
Eileenwikimedia/fundraising/crmmaster+12 -4
Eileenwikimedia/fundraising/crmmaster+107 -8
Eileenwikimedia/fundraising/crmmaster+16 -16
Eileenwikimedia/fundraising/SmashPigmaster+23 -25
Eileenwikimedia/fundraising/SmashPigmaster+126 -2
Eileenwikimedia/fundraising/SmashPigmaster+28 -6
Eileenwikimedia/fundraising/SmashPigmaster+0 -0
Eileenwikimedia/fundraising/SmashPigmaster+18 -4
Eileenwikimedia/fundraising/SmashPigmaster+9 -1
Eileenwikimedia/fundraising/SmashPigmaster+12 -8
Eileenwikimedia/fundraising/SmashPigmaster+79 -6
Eileenwikimedia/fundraising/SmashPigmaster+70 -40
Eileenwikimedia/fundraising/SmashPigmaster+50 -4
Eileenwikimedia/fundraising/SmashPigmaster+0 -3
Eileenwikimedia/fundraising/SmashPigmaster+76 -6
Eileenwikimedia/fundraising/SmashPigmaster+279 -165
Eileenwikimedia/fundraising/SmashPigmaster+6 -1
Eileenwikimedia/fundraising/SmashPigmaster+16 -14
Eileenwikimedia/fundraising/SmashPigmaster+1 -0
Eileenwikimedia/fundraising/SmashPigmaster+90 -3
Eileenwikimedia/fundraising/SmashPigmaster+68 -18
Eileenwikimedia/fundraising/SmashPigmaster+1 -1
Eileenwikimedia/fundraising/SmashPigmaster+1 -1
Eileenwikimedia/fundraising/SmashPigmaster+314 -100
Eileenwikimedia/fundraising/SmashPigmaster+4 -0
Eileenwikimedia/fundraising/SmashPigmaster+65 -4
Eileenwikimedia/fundraising/SmashPigmaster+62 -6
Eileenwikimedia/fundraising/SmashPigmaster+32 -4
Eileenwikimedia/fundraising/SmashPigmaster+9 -0
Eileenwikimedia/fundraising/SmashPigmaster+58 -52
Eileenwikimedia/fundraising/SmashPigmaster+6 -0
Eileenwikimedia/fundraising/SmashPigmaster+64 -26
Eileenwikimedia/fundraising/SmashPigmaster+53 -1
Eileenwikimedia/fundraising/SmashPigmaster+137 -62
Eileenwikimedia/fundraising/SmashPigmaster+5 -5
Eileenwikimedia/fundraising/SmashPigmaster+7 -4
Eileenwikimedia/fundraising/SmashPigmaster+7 -5
Eileenwikimedia/fundraising/SmashPigmaster+10 -6
Eileenwikimedia/fundraising/SmashPigmaster+4 -3
Eileenwikimedia/fundraising/SmashPigmaster+24 -6
Eileenwikimedia/fundraising/crmmaster+1 -0
Eileenwikimedia/fundraising/SmashPigmaster+5 -4
Eileenwikimedia/fundraising/crmmaster+240 -0
Show related patches Customize query in gerrit

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes

Change #1305527 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] chariot: add methodology to enforce metadata is kept up-to-date

https://gerrit.wikimedia.org/r/1305527

Change #1305530 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] chariot: stop outputting known metadata in unknowns report

https://gerrit.wikimedia.org/r/1305530

Change #1305533 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] chariot: handle newly appeared variants of daffpay fields

https://gerrit.wikimedia.org/r/1305533

Change #1305534 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] chariot: update unknown path collector internals

https://gerrit.wikimedia.org/r/1305534

Change #1305539 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] chariot: improve unknown reporting

https://gerrit.wikimedia.org/r/1305539

Change #1305540 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] chariot: unknown reporting - split output by type

https://gerrit.wikimedia.org/r/1305540

Change #1305541 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] chariot: add handling for alternate check_number location

https://gerrit.wikimedia.org/r/1305541

Change #1305543 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] chariot: add handling for donation level exchange rate

https://gerrit.wikimedia.org/r/1305543

Change #1305282 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] Chariot: add check_number (now we know where it is)

https://gerrit.wikimedia.org/r/1305282

Change #1305283 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] Chariot: move some more values to the donation object

https://gerrit.wikimedia.org/r/1305283

Change #1305284 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot: move matching gift values to Donation object

https://gerrit.wikimedia.org/r/1305284

Change #1305285 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot: declare field as known

https://gerrit.wikimedia.org/r/1305285

Change #1305286 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot: move unknown path functions to new class

https://gerrit.wikimedia.org/r/1305286

Change #1305292 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot: set is_daf if ANY daf info is present

https://gerrit.wikimedia.org/r/1305292

Change #1305293 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot: Rename 'is_endowment' to manual_review

https://gerrit.wikimedia.org/r/1305293

Change #1305335 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot: move some more functions to Deposit class

https://gerrit.wikimedia.org/r/1305335

Change #1305346 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot: Fix lack of rounding on converted settled amounts

https://gerrit.wikimedia.org/r/1305346

Change #1305353 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot: Add gateway_txn_id for rounding row

https://gerrit.wikimedia.org/r/1305353

Change #1305343 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot: fix selection of money where minor unit comparison was expected

https://gerrit.wikimedia.org/r/1305343

Change #1305522 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot: Prioritise matching gift over DAF

https://gerrit.wikimedia.org/r/1305522

Change #1305526 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot: move metadata handler to class

https://gerrit.wikimedia.org/r/1305526

Change #1305527 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot: add methodology to enforce metadata is kept up-to-date

https://gerrit.wikimedia.org/r/1305527

Change #1305530 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot: stop outputting known metadata in unknowns report

https://gerrit.wikimedia.org/r/1305530

Change #1305533 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot: handle newly appeared variants of daffpay fields

https://gerrit.wikimedia.org/r/1305533

Change #1305534 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot: update unknown path collector internals

https://gerrit.wikimedia.org/r/1305534

Change #1305539 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot: improve unknown reporting

https://gerrit.wikimedia.org/r/1305539

Change #1305540 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot: unknown reporting - split output by type

https://gerrit.wikimedia.org/r/1305540

Change #1305541 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot: add handling for alternate check_number location

https://gerrit.wikimedia.org/r/1305541

Change #1305543 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot: add handling for donation level exchange rate

https://gerrit.wikimedia.org/r/1305543

Change #1305340 abandoned by Eileen:

[wikimedia/fundraising/SmashPig@master] chariot: instantiate deposit object a little earlier & use a little more

https://gerrit.wikimedia.org/r/1305340

Change #1307005 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] Use property rather than passing api parameter around

https://gerrit.wikimedia.org/r/1307005

Change #1308263 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/crm@master] Chariot audit: add new fields to test csv files

https://gerrit.wikimedia.org/r/1308263

Change #1308268 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] chariot: more bubbling up of new fields

https://gerrit.wikimedia.org/r/1308268

Change #1308559 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] chariot: also validate early on the DonationAudit processor

https://gerrit.wikimedia.org/r/1308559

Change #1308590 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/crm@master] chariot: fix benevity fees

https://gerrit.wikimedia.org/r/1308590

Change #1308268 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot: more bubbling up of new fields

https://gerrit.wikimedia.org/r/1308268

Change #1308559 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot: also validate early on the DonationAudit processor

https://gerrit.wikimedia.org/r/1308559

Change #1307005 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] Use property rather than passing api parameter around

https://gerrit.wikimedia.org/r/1307005

Change #1308263 merged by jenkins-bot:

[wikimedia/fundraising/crm@master] Chariot audit: add new fields to test csv files

https://gerrit.wikimedia.org/r/1308263

Change #1308590 merged by jenkins-bot:

[wikimedia/fundraising/crm@master] chariot: fix benevity fees

https://gerrit.wikimedia.org/r/1308590

Change #1308810 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/crm@master] chariot: handle 0.00 where there is no value

https://gerrit.wikimedia.org/r/1308810

Change #1308810 merged by jenkins-bot:

[wikimedia/fundraising/crm@master] chariot: handle 0.00 where there is no value

https://gerrit.wikimedia.org/r/1308810

Change #1310236 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] Chariot: minor refactor Move functions to depositObject

https://gerrit.wikimedia.org/r/1310236

Change #1310239 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] Chariot: switch to later helper for amount for file

https://gerrit.wikimedia.org/r/1310239

Change #1310240 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] Chariot refactor - pass donationObject a little more & donation array a little less

https://gerrit.wikimedia.org/r/1310240

Change #1310242 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] Chariot refactor: add donations property to Deposit class

https://gerrit.wikimedia.org/r/1310242

Change #1310236 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] Chariot: minor refactor Move functions to depositObject

https://gerrit.wikimedia.org/r/1310236

Change #1310243 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] Chariot: refactor - use Deposit object more

https://gerrit.wikimedia.org/r/1310243

Change #1310244 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] Chariot: remove unused private function

https://gerrit.wikimedia.org/r/1310244

Change #1310245 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] chariot: move exchange-rate determination to Deposit

https://gerrit.wikimedia.org/r/1310245

Change #1310246 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] chariot: remove unused private functions

https://gerrit.wikimedia.org/r/1310246

Change #1310250 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] chariot finish move getExchangeRate to deposit class

https://gerrit.wikimedia.org/r/1310250

Change #1310253 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] Chariot: more passing Deposit object

https://gerrit.wikimedia.org/r/1310253

Change #1310254 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] Chariot: move buildFileName to Deposit

https://gerrit.wikimedia.org/r/1310254

Change #1310255 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] chariot extract getIncomingPath

https://gerrit.wikimedia.org/r/1310255

Change #1310257 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] chariot: do not download file if exists

https://gerrit.wikimedia.org/r/1310257

Change #1310239 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] Chariot: switch to later helper for amount for file

https://gerrit.wikimedia.org/r/1310239

Change #1310240 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] Chariot refactor - pass donationObject a little more & donation array a little less

https://gerrit.wikimedia.org/r/1310240

Change #1310683 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/crm@master] Chariot audit: handle poorly munged digital mailbox names

https://gerrit.wikimedia.org/r/1310683

Change #1310689 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/crm@master] Chariot assign anonymous DAF to the anonymous contact

https://gerrit.wikimedia.org/r/1310689

Change #1310690 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] Fixes to Rounding row

https://gerrit.wikimedia.org/r/1310690

Change #1310242 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] Chariot refactor: add donations property to Deposit class

https://gerrit.wikimedia.org/r/1310242

Change #1310243 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] Chariot: refactor - use Deposit object more

https://gerrit.wikimedia.org/r/1310243

Change #1310244 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] Chariot: remove unused private function

https://gerrit.wikimedia.org/r/1310244

Change #1310245 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot: move exchange-rate determination to Deposit

https://gerrit.wikimedia.org/r/1310245

Change #1310246 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot: remove unused private functions

https://gerrit.wikimedia.org/r/1310246

Change #1310250 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] chariot finish move getExchangeRate to deposit class

https://gerrit.wikimedia.org/r/1310250

Change #1310253 merged by Eileen:

[wikimedia/fundraising/SmashPig@master] Chariot: more passing Deposit object

https://gerrit.wikimedia.org/r/1310253

Change #1310254 merged by Eileen:

[wikimedia/fundraising/SmashPig@master] Chariot: move buildFileName to Deposit

https://gerrit.wikimedia.org/r/1310254

Change #1310255 merged by Eileen:

[wikimedia/fundraising/SmashPig@master] chariot extract getIncomingPath

https://gerrit.wikimedia.org/r/1310255

Change #1310257 merged by Eileen:

[wikimedia/fundraising/SmashPig@master] chariot: do not download file if exists

https://gerrit.wikimedia.org/r/1310257

Change #1310642 merged by Eileen:

[wikimedia/fundraising/SmashPig@master] Chariot: Convert settled amounts using major-unit exchange rates

https://gerrit.wikimedia.org/r/1310642

Change #1310690 merged by Eileen:

[wikimedia/fundraising/SmashPig@master] Fixes to Rounding row

https://gerrit.wikimedia.org/r/1310690

Change #1310647 merged by jenkins-bot:

[wikimedia/fundraising/crm@master] Log an alert when a chariot contribution has been tagged for review

https://gerrit.wikimedia.org/r/1310647

Change #1310683 merged by jenkins-bot:

[wikimedia/fundraising/crm@master] Chariot audit: handle poorly munged digital mailbox names

https://gerrit.wikimedia.org/r/1310683

Change #1310689 merged by jenkins-bot:

[wikimedia/fundraising/crm@master] Chariot assign anonymous DAF to the anonymous contact

https://gerrit.wikimedia.org/r/1310689

Change #1310909 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/SmashPig@master] Chariot: round settled matching gift if required

https://gerrit.wikimedia.org/r/1310909

Change #1310910 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/crm@master] Chariot: avoid passing null to string type

https://gerrit.wikimedia.org/r/1310910

Change #1310909 merged by jenkins-bot:

[wikimedia/fundraising/SmashPig@master] Chariot: round settled matching gift if required

https://gerrit.wikimedia.org/r/1310909

Change #1310910 merged by Eileen:

[wikimedia/fundraising/crm@master] Chariot: avoid passing null to string type

https://gerrit.wikimedia.org/r/1310910

Change #1311165 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/crm@master] Chariot use amounts from csv rather than recalculating

https://gerrit.wikimedia.org/r/1311165

Change #1311165 merged by jenkins-bot:

[wikimedia/fundraising/crm@master] Chariot use amounts from csv rather than recalculating

https://gerrit.wikimedia.org/r/1311165

XenoRyet set Final Story Points to 8.