Now on contact 77 Payment Processor Fee Bucket

@Ejegg another case where we have a mismatch - perhaps should be a new phab

@JMando

I mapped the use of the 'Fund' field against what we actually use to track Endowment - could do with some clean up
https://docs.google.com/spreadsheets/d/1Low7ytCMYerNeeeLERIKtMIHHPUGG01t6PJenE-kVug/edit?usp=sharing

@MDemosWMF Are you importing any Major Gifts donations & setting the Fund to 'endowment' & if so can we assume that ALL the donations you import with the Fund set to endowment are Major gifts - endowment should probably never have gone in the fund field since Analytics ignores it and it means we can't identify 'Endowment Major Gifts' - so just trying to figure out how to identify donations that are both endowment and major gifts based on the Gift Data

Field added - needs populating

Update - we have stopped this happening further and next need to repair the ones affected. A confluence of bugs caused this but the volume was ultimately fairly low - although a patch that went out today caused an increased rate - which is why I spotted it

The fields that would be overwritten are

This is on prod - see utm_medium & utm_source

Yeah - so we call the api & say 'generate us a report' - then it replies with the url where we can download the report from - so I don't know for sure what the possible urls are

I expect it's files.stripe - cos it kicks in when initiating the fetch of the report

@Dwisehaupt I see it here

@Dwisehaupt seeing fails on this one too

@Dwisehaupt we ARE hitting IP address limits

@AKanji-WMF - no we are good - we have what we need

These are now being gzipped when moved to ignored - can do for completed too it we want
Can also ignore one of the adyen files? https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/1247710?usp=dashboard

I've been putting up all sorts against this but I think it's time to merge one last patch - https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/1255913?usp=dashboard
and put this in Done & create new specific tasks

Success looks like this script downloading a file to the new dir

There should be no action on fr-tech here - Braintree doesn't generate settlement files

OK - I got a script & found the discrepancies

@Qgil Dallas did make the changes discussed back when he marked it as resolved & we did see a magic change in testing at that time :-) But no-one looped back to the phab

ALTER TABLE smashpig.pending

ADD COLUMN backend_processor VARCHAR(255) NULL,
ADD COLUMN backend_processor_txn_id VARCHAR(255) NULL,
ADD COLUMN payment_orchestrator_reconciliation_id VARCHAR(255) NULL,
ADD INDEX index_backend_processor (backend_processor),
ADD INDEX index_backend_processor_txn_id (backend_processor_txn_id),
ADD INDEX index_payment_orchestrator_reconciliation_id (payment_orchestrator_reconciliation_id);