Fri, Sep 20
This also ties in with the batch data entry task (T230450)
Mon, Sep 16
@Eileenmcnaughton Awesome thanks so much!!
Wed, Sep 4
@Eileenmcnaughton I created a new import "TargetSmart Import 2019 - Gender" and added the Primary -Supplemental Address 1 field as the last field in the mapping. Does the file need to be updated as well?
Tue, Sep 3
Got it. Could I create a new import mapping to not mess with the field mapping for the future? As you know, the current export mapping page can be cumbersome to deal with.
@Eileenmcnaughton Is it possible to just import the Gender column? The rest of the information is already imported.
Thu, Aug 29
Ah got it. Well that's not TOO bad then.
Great news! Were there many rows with bad data that caused issues?
Tue, Aug 27
Wonderful! Thanks so much.
Aug 19 2019
Ah I see those now! These look good to me.
Aug 15 2019
@Eileenmcnaughton Thanks! I just looked at them and it seems that the street address is missing from the Old 2019 address and all of the prospect fields are missing. Is it set up so that if there is a change in address, it would be fully included? I think we'd want both in there.
Aug 14 2019
I know. :( Sometime in the next month would be great. I can manually update in the meantime.
Jul 25 2019
@Eileenmcnaughton Hm that's odd! Those values ($250,000 - $499,999, $750,000 - $999,999) were used in the previous import this spring and are already in the drop down options for the Estimated Net Worth Field. Does that mean that only the old ones are reflected in the db? I see all the new ones I added under the multiple choice options, which should have all the needed mappings.
Jul 24 2019
@Eileenmcnaughton No, for some reason, the street address is called that in their file.
This is great, thanks @Eileenmcnaughton! Yeah they do have some extra/unneeded columns in there (mostly duplicate type fields as you've seen).
Jul 8 2019
Jun 10 2019
Apr 25 2019
Wonderful - thank you!! Looks like the count has gone down a lot to ~1600. I'm guessing those are the ones that don't have matches since the merge list is much lower, but will give it some more time.
Apr 24 2019
Confirmed that it looks like lots still need to be matched. The number hasn't changed in the past hour or so. Does it do the matching in spurts or could we possibly do a specific dedupe job to match the rest if there was some sort of issue?
Okay so I was able to import the whole list in segments. @Eileenmcnaughton How long would you suggest waiting for the dedupe to fully scan? A chunk of the list have deduped but don't want to delete any with just email address if it's still doing its thing.
@Eileenmcnaughton Sorry false alarm - the dedupe process was just taking longer than expected. I think the fix worked!
So I just tested a few and now it seems like it's creating duplicate records for all of them, even those that should match on email. Example: CIDs
31744803 and 31744756 are already in Civi but the import created CIDs 31887442 and 31887441.
@Eileenmcnaughton Hooray! I'll test today and let you know my results.
Apr 17 2019
@Eileenmcnaughton This report also seems to be acting out with getting out of order: instance/145
Apr 15 2019
Thanks @Eileenmcnaughton. That seems to have worked!
Apr 12 2019
@Eileenmcnaughton I've been testing around and cleaning up the listings. Overall it works great! Some wonkiness occurred with the Benefactors 15000-49999 report though after a few times of refreshing the report, and now it seems to be out of order after going through and updating the Order as field.
Mar 25 2019
Examples discussed in Fortnightly:
Mar 20 2019
@Eileenmcnaughton Thanks! I love that idea of removing 'The' from the sort name and using that to help dedupe. I have a feeling that has caused a fair amount of unseen dupes.
Mar 18 2019
@MBeat33 I think these requests would be useful! I also usually use the oldest record to merge any pertinent new data into when merging two records. Re: 2a., would the default on the right side of the interface result in the older record being considered as the duplicate and then getting merged into the newer one?
Mar 12 2019
Okay great! Then I think we're all set. :) Thanks @Eileenmcnaughton.
@Ejegg That worked! One thing I noticed is that the contacts all show under the contact "Citibank" rather than "Citibank Import." Not sure if that matters, but wanted to flag. :)
@Eileenmcnaughton I attempted the same files on Live but it's giving me an error message: "This page isn’t working civicrm.wikimedia.org is currently unable to handle this request.
HTTP ERROR 500"
Mar 8 2019
Okay the latest test was a success!
@Ejegg Oh interesting! It Looks like Finance added that in by accident. I'll test again.
Mar 7 2019
Thanks! I just tested and overall is working well. I imported the September tab and 1 of them was rejected as a duplicate. Could it be because there were 2 donations of the same amount?
@Eileenmcnaughton thanks, these look great. Some comments to your questions are below!
Mar 1 2019
Feb 28 2019
It went well! Thanks so much, @Eileenmcnaughton!
Feb 22 2019
My initial testing has gone well overall, but there seems to be a big discrepancy in the total of what I imported and what shows under Find Contributions. The total in Civi is much lower. I'm not sure why though because the fees seem to be reflecting accurately.
Feb 21 2019
Ah yes, that seems right. I just looked at their report glossary and Merchant Fee indicates "This fee applies to the costs associated with processing credit card, PayPal or similar transactions." I think it's fine to put the fee with the individual's contribution and add it to any donation fees.
Feb 20 2019
Thanks @Eileenmcnaughton. I just did a test of ~20 rows. The fees seems to be reflecting correctly for those with fees on the individual amount, but the rows with a "Merchant fee" are being associated with the individual's portion rather than the company's match.
Feb 19 2019
I'm also getting this timeout response when I try searching name.
Feb 11 2019
The name search returned results so it appears to be working for me now.
Feb 6 2019
Thanks for clarifying! I'll make a note going forward of which batches we reclassify the financial type from Engage to Endowment gift. Okay to close.
Feb 4 2019
Jan 16 2019
Dec 17 2018
Sure! Thanks very much.
Nov 19 2018
Thank you @Eileenmcnaughton!
Nov 14 2018
Nov 12 2018
Nov 6 2018
Oct 30 2018
It stopped and said that all rows were imported, but when I checked an hour or so later, it still showed only 100 records added.
Ah got it. So if I leave it at a smaller number like 100, it will still import the whole file but in pieces? I first had it on 100 but noticed that most of it wasn't showing in Civi so then tried a second time with 1810 items.
Okay I tried importing and updating the number of items, but it timed out with my file. Is there a maximum number of rows it can accept?
@Eileenmcnaughton Is the "number of items to process each batch" the number of rows in the file? If so, does this exclude the header?
Oct 23 2018
Will do! I should have a large file later this week.
Oct 11 2018
Engage just reported that the anonymous record isn't working for them today. From one of their staff: "I am unable to record donations in anonymous this afternoon. When I save the donation it just spins forever. I refreshed after about 5 minutes. This is happening consistently today."
Oct 5 2018
I didn't have the same issue when I just tested, but it was a bit slow.
Oct 2 2018
Sep 27 2018
@Eileenmcnaughton I just did imported a new large file and it led to a 504 timeout error.
Sep 21 2018
@Ejegg I just placed the latest files on the server: Tech/Major Gifts/Engage Import/Trashed donations
Sep 19 2018
Sep 18 2018
@Ejegg Is this resolved?
Sep 10 2018
Sep 4 2018
@Eileenmcnaughton Yep! Thanks for removing the restriction.
Aug 28 2018
That would be great. Thank you!
That makes sense. Could we add in Corporate Gift to the code? I also don't think we really need the restriction.
Aug 17 2018
Awesome - thanks! Happy to go over next week.
@Ejegg For the Engage import, I believe it defaults to send one. For the donations they enter by hand, we don't always want an automatic TY email because they enter matching gifts and donor advised funds, etc., which don't need the tax-exempt statement and have different TYs.
Aug 16 2018
Aug 13 2018
Aug 6 2018
@Eileenmcnaughton @cwdent Thanks for your help with this fix. The latest from Chris is that the change sped up the page load to get into the Anonymous record, however, it still is slow to save entries.
Aug 1 2018
@Eileenmcnaughton I just received a note from Chris that the anonymous record isn't working at all for them now. It shows as a blank page for them. Could this have to do with the deploy?
@DKaufman Is this still needed or okay to close?
Jul 12 2018
Thanks @Ejegg! The import worked with importing the donations. The one thing I noticed is that there were 5 rows showing as missed (refunds and other tx types), but the file log only includes one of the rows. Not sure if this is an issue but want to flag.
Jul 2 2018
Jun 20 2018
@Eileenmcnaughton Yes - thank you!
Jun 13 2018
All set now. Thanks @cwdent!
Jun 4 2018
Okay, we now have a Partner field! Could you take a look to make sure it's set up as it should be?
May 30 2018
May 29 2018
May 8 2018
May 2 2018
Ah, that was the problem. :) Thanks!
Apr 24 2018
@Eileenmcnaughton I'm not seeing the send thank you letter option from the drop down under Advanced Search on the staging site. Was this updated?
Apr 17 2018
Thanks! I think we can proceed with closing and then continue to monitor the next few imports.