Page MenuHomePhabricator

July 30th: Removing Data Axle CE fields from Civi - License Expiring
Closed, ResolvedPublic8 Estimated Story Points

Description

We found out last year that the data license with Data Axle only lasts for one year and we need to renew (pay a fee) or it will expire. Last year we renewed and kept the consumer enhancement field data in Civi, but this year we are not renewing since the data is likely aged. We will want to do an enhancement this year to refresh, but we will use Faircom's data vendor.

Because we are not renewing we'll need to remove this data from Civi per the agreement with Data Axle. This is only the consumer enhancement fields and not including the previous NCOA, DOB, deceased data. I'm sure this will require a bit of work so we wanted to see how we might go about doing this and what it would entail. The deadline to remove this data is July 30, 205.

Here is the document that outlines the CE fields we need to remove under tab "New Fields to update."

These fields live on the prospect tab and have a prefix of (DA):

Screenshot 2025-06-03 at 9.41.27 AM.png (716×328 px, 65 KB)

Details

Due Date
Jul 25 2025, 4:00 AM
Related Changes in Gerrit:

Event Timeline

Looping in @RLewis and @AFowler-WMF to see if these fields are currently being used by MG team? If so maybe we can coordinate with Faircom's data vendor to get this data updated/replaced in July after the old DA data is removed. Then perhaps we could rename these fields and reuse for the new data if applicable.

@MDemosWMF - we were going to use some of these fields to help screen donors for inclusion on our MGFE appeals for FY25-26. For FY24-25, we used them and the upgrade asks we did for this cohort worked well so we were going to look at this again for this year. I'm due to pull this data next week for our MGFE suppression lists which is before the deadline you mentioned.

Fields we use are DA Networth, Expendable Income, high value security investor and high value stock investor.

I think it would be good to get this data updated, are we saying that Faircom has similar data that corresponds with the DA fields.

@MDemosWMF - also do you have any information/field the Faircom data will include?

@RLewis We haven't gotten that far yet, I think we will be coordinating that with Faircom/VeraData and could try and find the same or similar data fields @MSuijkerbuijk_WMF has added a meeting to the calendar to discuss further. Sounds like we will need to coordinate on timing of getting this data updated for your FY2526 appeals

AKanji-WMF set Due Date to Jul 25 2025, 4:00 AM.
AKanji-WMF renamed this task from Removing Data Axle CE fields from Civi - License Expiring to July 30th: Removing Data Axle CE fields from Civi - License Expiring.Jun 17 2025, 7:25 PM
Damilare set the point value for this task to 8.Jun 24 2025, 8:26 PM

@AKanji-WMF Checking in on where this stands with deadline approaching

Thanks! This is in our current sprint and on @Eileenmcnaughton 's radar!

@MDemosWMF I have disabled the fields in question over at https://civicrm.wikimedia.org/civicrm/admin/custom/group/fields#/?gid=5 - next I will remove any disabled fields - can you check both that all the disabled fields should be removed and if there are any other prospect fields that are still enabled & should be removed (some were already disabled)

Thanks @Eileenmcnaughton ! I can confirm that the fields marked (DA) should be removed and I can see they are already disabled. Just want to confirm with @ERoden-WMF - Are we OK to move forward with this next step of removing the fields?

Also looping in @DBautista-WMF to review the prospect fields as a whole and weigh in on any that should be removed outside of the DA fields as I am unsure.

@RLewis and @AFowler-WMF want to make sure you are good with your lists before we move forward with removal. Erica has given the ok on her end. Thanks!

@MDemosWMF - thanks for checking on this, i have the donors with the DA data we needed in a group so we should be all good.

@Eileenmcnaughton Looks like we are approved to move forward!

@Eileenmcnaughton just checking in on the status of this - thanks!

We will probably fully remove them when we do the civi upgrade

Change #1184165 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/crm@master] Remove data axle fields

https://gerrit.wikimedia.org/r/1184165

Change #1184191 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/crm@master] Remove fields from install

https://gerrit.wikimedia.org/r/1184191

Change #1184165 merged by Ejegg:

[wikimedia/fundraising/crm@master] Remove data axle fields

https://gerrit.wikimedia.org/r/1184165

Change #1184191 merged by Ejegg:

[wikimedia/fundraising/crm@master] Remove fields from install

https://gerrit.wikimedia.org/r/1184191

Change #1184496 had a related patch set uploaded (by Eileen; author: Eileen):

[wikimedia/fundraising/tools@master] Handle removed dataaxle fields

https://gerrit.wikimedia.org/r/1184496

XenoRyet set Final Story Points to 4.