Sign off: @CaitVirtue
When we export search results from civi, there's currently not a way to see who is marked as "do not solicit," as these fields are not included in the primary fields list. This is problematic as we don't want to mistakenly contact these people, especially when we've taken the time to mark them properly in Civi.
(there may be a better export to use to get this data. If anyone knows that, I'd be interested to learn.)
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | awight | T105918 Adding 1 Custom field to "primary fields" export list: Do Not Solicit | |||
| Declined | None | T112983 Find a more nuanced way to add a few custom fields to the default exports |
@CaitVirtue what's the urgency for you on this? I think we probably want this to be taken care of before big EN, but anything more pressing than that?
@atgo definitely before big EN. Given the time that we pull the lists for that by late-October would be ideal.
Can we make sure to touch base on what this will look like from a UI perspective before we start the work?
@awight--Will this task only change the import, or also where the field appears on the contact record?
Change 238636 had a related patch set uploaded (by Awight):
Include custom fields in default export
@CaitVirtue: Doing this surgically turns out to be either tricky, fragile, or both. So I've made a pretty outrageous code change which will include all custom fields along with the "Primary fields" export. This expands the number of columns to approximately 110, please holler if your team is drowning in double-letter column headings.
@awight: I just ran a query for donations over 10k this fiscal and exported the primary fields, to see how cumbersome the additional fields might be, but I don't see the Do Not Solicit field, nor any of the additional custom fields. Is it not implemented yet? If not, I would love to see some test results before we move forward with this. I have some reservations about having all those fields in the results.
@CaitVirtue: Thanks for taking a look at this! I've put the code on the staging server, all export types should be affected.
Here's an example contact export:
"Internal Contact ID","Contact Type","Contact Subtype","Do Not Email","Do Not Phone","Do Not Mail","Do Not Sms","Do Not Trade","No Bulk Emails (User Opt Out)","Legal Identifier","External Identifier","Sort Name","Display Name","Nick Name","Legal Name","Image Url","Preferred Communication Method","Preferred Language","Preferred Mail Format","Contact Hash","Source of Contact Data","First Name","Middle Name","Last Name","Job Title","Birth Date","Is Deceased","Deceased Date","Household Name","Organization Name","Sic Code","Unique ID (OpenID)","Current Employer ID","Contact is in Trash","Addressee","Email Greeting","Postal Greeting","Gender","Individual Prefix","Individual Suffix","Current Employer","Location Type","Street Address","Street Number","Street Number Suffix","Street Name","Street Unit","Additional Address 1","Additional Address 2","City","Postal Code Suffix","Postal Code","Geo Code 1","Geo Code 2","Address Name","Master Address Belongs To","County","State","Country","Phone","Phone Extension","Email","On Hold","Use for Bulk Mail","Signature Text","Signature Html","IM Provider","IM Screen Name","OpenID","World Region","Website","Language","Invalid mailing address","Invalid E-mail Address","Survey Group","Origin","Steward","Solicitor","Biography","Philanthropic History","Subject Area Interest","Interests","University Affiliation","Stage","On Hold","Affinity","Capacity","Reviewed","Income Range","Charitable Contributions Decile","Disc Income Decile","Voter Party","Assitant Name","Assistant Contact","Listed as","Do not solicit","Is 2006 donor","Is 2007 donor","Is 2008 donor","Is 2009 donor","Is 2010 donor","Is 2011 donor","Is 2012 donor","Is 2013 donor","Is 2014 donor","Is 2015 donor","Is 2016 donor","Is 2017 donor","Is 2018 donor","Is 2019 donor","Is 2020 donor","Is 2021 donor","Is 2022 donor","Is 2023 donor","Is 2024 donor","Is 2025 donor","Last Currency","Last Donated","Last Orig Amount","Last USD Amount","Lifetime USD Total","Name","Title","Email","Phone","Street Address","Supplimental Street Address","City","Zip Code","State","Country","Group(s)","Tag(s)","Note(s)","Phone Type","Im Service Provider" "6549663","Individual",,,,,,,,,,"Wight, Adam","Adam Wight",,,,,"en_US","Both","395a3417bdd8d634285f39250c76e39a","online donation","Adam",,"Wight",,,,,,,,,,,,,,,,,,"Home","123 Rocky Rd",,,,,,,"Hobbiton",,"94703",,,,,,"CA","United States",,,"aw@wikimedia.org",,,,,,,,"America South, Central, North and Caribbean",,,,,,,,,,,,,,,,,,,,,,,,,,"No","No","No","No","No","No","No","No","Yes","No","No","No","No","No","No","No","No","No","No","No","No","EUR","April 21st, 2014 9:48 PM","1.00","1.38","1.38",,,,,,,,,,,,"Review,Quick autoreviewed,Generous",,,
And a contribution export has... different extra fields:
"Internal Contact ID","Contact Type","Contact Subtype","Do Not Email","Do Not Phone","Do Not Mail","Do Not Sms","Do Not Trade","No Bulk Emails (User Opt Out)","Legal Identifier","External Identifier","Sort Name","Display Name","Nick Name","Legal Name","Image Url","Preferred Communication Method","Preferred Language","Preferred Mail Format","Contact Hash","Source of Contact Data","First Name","Middle Name","Last Name","Job Title","Birth Date","Is Deceased","Deceased Date","Household Name","Organization Name","Sic Code","Unique ID (OpenID)","Current Employer ID","Contact is in Trash","Addressee","Email Greeting","Postal Greeting","Gender","Individual Prefix","Individual Suffix","Current Employer","Location Type","Street Address","Street Number","Street Number Suffix","Street Name","Street Unit","Additional Address 1","Additional Address 2","City","Postal Code Suffix","Postal Code","Geo Code 1","Geo Code 2","Address Name","Master Address Belongs To","County","State","Country","Phone","Phone Extension","Email","On Hold","Use for Bulk Mail","Signature Text","Signature Html","IM Provider","IM Screen Name","OpenID","World Region","Website","Language","Invalid mailing address","Invalid E-mail Address","Survey Group","Origin","Steward","Solicitor","Biography","Philanthropic History","Subject Area Interest","Interests","University Affiliation","Stage","On Hold","Affinity","Capacity","Reviewed","Income Range","Charitable Contributions Decile","Disc Income Decile","Voter Party","Assitant Name","Assistant Contact","Listed as","Do not solicit","Is 2006 donor","Is 2007 donor","Is 2008 donor","Is 2009 donor","Is 2010 donor","Is 2011 donor","Is 2012 donor","Is 2013 donor","Is 2014 donor","Is 2015 donor","Is 2016 donor","Is 2017 donor","Is 2018 donor","Is 2019 donor","Is 2020 donor","Is 2021 donor","Is 2022 donor","Is 2023 donor","Is 2024 donor","Is 2025 donor","Last Currency","Last Donated","Last Orig Amount","Last USD Amount","Lifetime USD Total","Name","Title","Email","Phone","Street Address","Supplimental Street Address","City","Zip Code","State","Country","Phone Type","Im Service Provider","Contribution Type","Contribution Source","Receive Date","Thank-you Date","Cancel Date","Total Amount","Accounting Code","Payment Instrument","Check Number","Non-deductible Amount","Fee Amount","Net Amount","Transaction ID","Invoice ID","Currency","Cancel Reason","Receipt Date","Product Name","SKU","Product Option","Fulfilled Date","Start Date","End Date","Test","Is Pay Later","Contribution Status","Recurring Contributions ID","Amount Label","Contribution Note","Batch Name","Campaign ID","Campaign Title" "3022116","Individual",,,,,,,,,,"Wight, Adam","Adam Wight",,,,,"en_US","Both","601dde39b840110484dd79a74aa98c64","online donation","Adam",,"Wight",,,,,,,,,,,"Adam Wight","Dear Adam","Dear Adam",,,,,"Home","123 Rocky Rd",,,,,,,"Hobbiton",,"94703",,,,,,"CA","United States",,,"aw@wikimedia.org",,,,,,,,"America South, Central, North and Caribbean",,,,,,,,,,,,,,,,,,,,,,,,,,"No","No","No","No","No","No","No","Yes","No","No","No","No","No","No","No","No","No","No","No","No","No","USD","November 29th, 2012 8:24 PM","1.25","1.25","1.25",,,,,,,,,,,,,"Cash","USD 1.25","2012-11-29 20:24:33","2012-11-29 20:25:55",,"1.25","CASH","Credit Card: Visa",,"0.00","0.00","1.25","GLOBALCOLLECT 1122925116 1354220673",,"USD",,,,,,,,,,,"Completed",,,,,,
Wow, that's a ton of fields, but it's so important for us to have Do Not Contact that I think this is an OK temporary fix.
@DStrine: Do I need to create another task to request a more nuanced, long term solution?
@CaitVirtue Adam already made one: T112983
However this will likely end up being a core civi change. It will probably be a big conversation and a longer process.
Change 238636 abandoned by Awight:
Include custom fields in default export
Reason:
was merged, but this changeset is stuck in a time warp.
Change 241966 had a related patch set uploaded (by Eileen):
Merge from master :Include custom fields in default export
Change 241966 merged by Eileen:
Merge from master :Include custom fields in default export
@CaitVirtue: This is ready to try out on the production server, please let us know whether it works.
(Sorry for the repeat) As a quick and dirty solution, this works, but this is definitely not a long term fix. The primary fields export now includes columns A-EJ. Too much! Can we table for now and revisit in very early Q3?
@CaitVirtue
Okay--closing this task and we'll continue work on T112983 soon enough...
Change 410378 had a related patch set uploaded (by Eileen; owner: Awight):
[wikimedia/fundraising/crm/civicrm@master] Merge from master :Include custom fields in default export
Change 410378 abandoned by Eileen:
Merge from master :Include custom fields in default export
Reason:
looks like we have already lost this from master without anyone noticing ...