Page MenuHomePhabricator

Parse Amazon last name data differently (or: review the way we receive Amazon name data)
Open, MediumPublic1 Estimated Story Points

Description

Urgency: Low (Amazon related)
Impact to donors: Difficult for donor services to confirm donations

During December, we corresponded with a few dozen Amazon donors who thought they hadn't received their email receipt. We tried to find them in Civi under their name or email (a lot of people use old email addresses for Amazon which explains that portion), but couldn't locate the donation, even when donors were sending us screenshots from their Amazon accounts showing the payment.

I found out the reason why we couldn't find these people by searching Last Name, First Name is because Amazon sends many of their donor names in this format: [Middle Initial] [Last Name], [First Name]. So if we don't know the middle initial, we'll never find them. We now know to ask donors for their MI, but it would be great if we could cut out that last step (and need for a different process for Amazon donations).

Can we look into how we receive Amazon name data, and if it's possible to throw these middle initials out?

Event Timeline

CCogdill_WMF assigned this task to atgo.
CCogdill_WMF raised the priority of this task from to Needs Triage.
CCogdill_WMF updated the task description. (Show Details)
CCogdill_WMF subscribed.
atgo claimed this task.

Good thinking @CCogdill_WMF, but unfortunately amazon only gives us (and only asks for on their side) a single field for this. Parsing a single field isn't something we really want to explore (since different people like different things, let alone language/country norms).

Here's a screenshot of what that looks like in my account:

Screen Shot 2015-08-21 at 3.42.56 PM.png (238×649 px, 23 KB)

Amazon actually just sends us one field for name (and only stores one on their side). We've been putting everything up to the first space in the first name field, and the rest in the last name. This is on the theory that we usually use the first name alone for email greetings and want that to look natural. It's also tough for a computer to tell the difference between a first name / last name like "Miguel De Icaza" and a first/middle/last like "Elliott James Eggleston".

Thanks @Ejegg, that explanation makes sense. I had hoped Amazon sent first
and last name data separately, but I can see how it would be hard to come
up with a good rule to distinguish middle initials from last names with
more than one word. I appreciate you looking into it!

@MBeat33 ping to make sure you saw this - the Amazon middle initial issue
won't change.

Could we modify the Civi import so that if there is only a single initial after the first name (or a single initial plus a period), it would import as ‘public, john q’? Might that change still allow ones like ‘de beattie, michael’ to import correctly?

I ask only because when Zendesk ticket volume ramps up during big-EN these tickets take an inordinate amount of time to resolve. I know this can't be a priority currently, but if there's any space to finesse this before December it would be great.

awight raised the priority of this task from Low to Medium.Aug 25 2015, 6:45 PM
awight subscribed.

@MBeat33: Can you explain the impact this is having on your process? It sounds like the last name search only does prefix matching or something?

@awight, Amazon gives us little for search parameters at their portal. If we need to locate a transaction in Civi it's basically a name search, as donors don't have a transaction ID to provide us. We may know the donors first and last names, but if the transaction reaches Civi as 'P Beattie, Michael' we typically need to contact the donor to ask their middle initial in order to confirm that we've located the correct transaction. Civi doesn't seem to allow a wildcard search for '* beattie, michael' or '*. beattie, michael'. I am trying to remove the extra time going back and forth with donors this step adds to confirming or refunding donations.

@atgo: I'm losing it. I swear I responded yesterday, but the gist was that I increased priority to normal cos this is impacting the donor services workflow.

@MBeat33: Civi does have a wildcard search, it's horrendously slow and confusing, but for your example, you could type "%beattie". It takes a few minutes. FYI, there's another thing we can do if this is too painful--we can add a fulltext search index. That would mean pretty much instantaneous results for any kind of name search you want to run.

@awight thank you, I tested the % wildcard on some Amazon donor records and though slow it seems to find them often enough. If altering the name import function to account for middle initials would affect the first name greetings in TY emails then I think we can get by with the wildcard. I will update the DS documentation so payment processor agents know to use the wildcard for elusive donors. Thank you for looking into this.

@CCogdill_WMF and @MeganHernandez_WMF
We touched on this briefly today, and tech would like to know what you think about the following: when we're dealing with processors with mangled name data such as Amazon, we have an accurate full name, but can't give a decent first or last name. How about, we use the full name for these cases?

We could find a way to export names into silverpop so your template doesn't have to know any of this

The new Amazon Seller Central portal allows for searching by email address, so we won't be solely reliant on Civi to locate disputed transactions.

@awight this isn't a scientific assumption, but my experience of reviewing Amazon name data is that the first name is generally sensible, but the last name is off. Even if someone has a two word first name (let's say John Paul), I don't think it's wildly problematic to call that person "John". Because we mostly only use first names in email, I don't see the need to put work into improving the parser for this purpose.

@CCogdill_WMF
Good point--Amazon is currently only for the US, where first-name salutation is kosher.

When we do expand the places we're offering Amazon, however, we might want to revisit this. JFYI, the workaround I'm suggesting isn't in our parser, it would be something we do in the Silverpop export job and in the Thank-you job. Meaning that we're fine taking names in exactly as we do, and we can always fix the outbound jobs at a later date.

@awight sure, let's remember this as Amazon expands. I'm thinking about
Japan specifically...