Page MenuHomePhabricator

Model payments data from the payment-service-provider recon data in CiviCRM in the data lakehouse into the format for export into Sage Intacct
Closed, ResolvedPublic

Description

Model payments data from payment-service-provider recon data in CiviCRM into format for export into Sage Intacct

The inputs to our model that will be in CiviCRM are here:
Gr4vy specs
In spreadsheet form

Desired output to Sage Intacct: requirements

We will need some sort of vendor ID
Timestamp may need to be truncated to date
Any time zone is fine
May need to filter transactions based on record type
We'll need an endowment-based file uploaded separately from an annual-fund upload (filter on gift type)
May want to wait to send file to Intacct only of donations that have been confirmed from processor because of potential spoof or unfinished donations. Would mean a lag, but less thrashy.

Related files in Google Drive Sage Intacct Integration folder
Sample Intacct upload
General ledger mapping for checks
Integration doc

Event Timeline

This can be closed, right, since the mapping is being done in Civi?

@IAckerman-WMF I am uncertain. While FRTech is mapping the data in Civi, I assume that Civi data will reside in the Data Lake and we can build reporting around the recon for Operations, correct? There is a reporting need for Operations to validate the Civi data to PSP to Intact, I think to verify accuracy. It is unclear to me how we are going to get such a report at this time. @ERoden-WMF Your thoughts?

Yes, that sounds right to me @EMartin. We don't need to model for the export into Intacct, but I'd like us to be able to run reporting by date, psp, budget and gl code so we can easily compare to the monthly reconciliation with Finance (and identify where discrepancies are). Eileen has developed an email that shows the batches that have been generated, but I'd like to be able to report off the same data in an aggregated way. @IAckerman-WMF I'll forward you the sample batch report Eileen shared. Also, currently there's variances between our reporting in Metabase and what Finance reports (partly how things are categorized and things like fees). I'm hoping we get to a place where that's no longer the case, and Civi, Metabase and Finance's systems all tie out. I'm adding @Eileenmcnaughton here for her thoughts as she's been doing all the work on this and may have a different perspective.

Got it, sounds good. Since it sounds like this won't require SRE or data engineering work, I've captured the reporting and modeling work in Asana, and we can pick up the conversation there. | Task

Thanks both. Starting to come into focus.