Page MenuHomePhabricator

Data axle -import deceased date
Closed, ResolvedPublic

Description

We have this data for some contacts - we left out of the first round of import as Nora felt there should be a process around this data

Event Timeline

@NNichols FYI some numbers - there are 920 in the second import & 799 in the first import

However, the first one I spot checked has donated since he died?? https://civicrm.wikimedia.org/civicrm/contact/view?reset=1&cid=54631749 (there is no birth date in their data for him)

select _entity_id FROM civicrm_tmp_d_dflt_422d456c84c29150e615ba3c33566152 WHERE dc_deceasedflag_154 <> 'N' ;
select _entity_id FROM civicrm_tmp_d_dflt_cb3073f1f3fbd3546df65be0db883c97 WHERE dc_deceasedflag_154 = 'Y';

+------------+

_entity_id

+------------+

23207849
58887456
24287983
39026019

These are from the smaller file

50384061
51717911
51936157
52171522
52273564
52359686
52438575
52631054
52677676
53055062
53341013
53544999
54453347
54496926
54569159
54627920
54631749
54746526
54753639
54778667
54792909
54936537
56188748
57033424
57051007
57640200
58053011
58057982
58387706
58482979
58585882
58939540
58939647
59170232
59174197
59186487

+------------+

Thanks Eileen for checking that. I also took a look at the ones in the large file you listed and from a quick search it looks like perhaps the data is confusing a sr. with a jr. or those with a similar name? From the obituaries I saw they are sometimes listed in the surviving family. Also they have given fairly recently compared to the obit dates I found. It would be hard to verify such a large volume.

I don't want to import the deceased flag if it is inaccurate. @ERoden-WMF should we reach out to Data Axle?

I agree @MDemosWMF. If we're not confident with the data we shouldn't import. Could you reach out the DA with some examples and ask them to look into it for us? Thanks

@MDemosWMF @NNichols we talked about getting some more information to help you decide what to do about these contacts.

I have put them all into a group in CiviCRM & you can view them via this search https://civicrm.wikimedia.org/civicrm/search#/display/Contacts_marked_deceased_possibly_inaccurately_in_data_axle_import

Some rough numbers from the larger of the 2 files - I exported another 800 from the smaller function after I wrote the below

2232 contacts marked deceased in Data Axle
2197 of those found in Civi & not deleted, deceased already
2 oddballs where they have deceased dates but not the is_deceased flag
around half of the contacts have given since the Data Axle data was provided I think
7 of the contacts would be over 100 :-)
around 70 of the contacts would have lifetime giving over $500

You can bulk edit the contacts from that view if you want to mark selected ones deceased or remove them from the view

I'm thinking this might be enough to close this phab & leave it with you to take from here?

Yeah I think so as well. We can break this list down further and have major gifts decide for those with significant lifetime giving (I already see a few over $4k) and perhaps have DR help with the rest @MDemosWMF What do you think?

@NNichols Yes, that sounds good! Thanks Eileen!

Eileenmcnaughton set Final Story Points to 2.