Page MenuHomePhabricator

Investigate Japanese unintended recurring donations
Closed, ResolvedPublic

Description

@KHancock99 noticed that even though the form at https://donate.wikimedia.org/w/index.php?title=Special:LandingPage&uselang=jp&country=JP&utm_medium=Waystogive&utm_source=Waystogive&utm_campaign=C11_Waystogive specifies uselang=jp, some of the labels on the form are still in English:

JPButtons.jpg (966×2 px, 418 KB)

We've received ~150 unintended recurring complaints from Japan so far in September, and this is likely related. Can we modify the form to translate these fields into Japanese? This is donor-facing and generating lots of help requests.

Event Timeline

MBeat33 triaged this task as Unbreak Now! priority.Sep 9 2020, 12:12 AM

Hmm this is very strange. We proofed this and updated the translations back in July, as there is a comment thread on the jaJP main translation file discussing this specific landing page (as opposed to the email landing page) and that some of the translations that were originally missing (pre-campaign launch) were updated and ready to go. @Pcoombe any thoughts/ideas on how this broke?

As for the Japanese translations for the strings that are still in English, they reside here (see page 42): https://docs.google.com/document/d/1OE3SZxmJM0UCH40OnDMWG4GXI-bIX3kfVLi7_-7h8C4/edit#heading=h.o4ydju6wsxr2

When clicking the link Michael added I get the text in English as well, however, I think the language parameter may be wrong using jp rather than ja.

when updating to ja in the URL I see the text in Japanese.

https://donate.wikimedia.org/w/index.php?title=Special:LandingPage&uselang=ja&country=JP&utm_medium=Waystogive&utm_source=Waystogive&utm_campaign=C11_Waystogive

Could it be that some donors are getting to the link using jp in the URL?

Thanks Jessica. I also tested out the flow. Starting from the WTG page, I clicked on Japanese (in the language bar), then clicked on Asia dropdown; selected Japan, and it takes me to the Japanese WTG page with language code JA. The translations display correctly. I also tried the donate link from the sidebar of the Japanese Wikipedia and the landing page displays correctly. I am stumped!

I can't figure out where these incorrect jp language codes are coming from. Looking at pgehres.landingimpressions_raw there's about 34 since the start of the campaign, almost all with either:

utm_sourceutm_campaignutm_medium
WaystogiveC11_WaystogiveWaystogive
TwitterThankYouPageSocialMedia

However I checked all the links on Ways to Give and in the Thank You page social media links, and they all use the correct uselang=ja.

I tried putting in redirects and copies of the translations at the /jp subpages as a fix, but that doesn't work. {{int:}} seems to just ignore anything that's not a valid language code.

Pcoombe lowered the priority of this task from Unbreak Now! to Needs Triage.Sep 9 2020, 4:31 PM
Pcoombe added a project: donate.wikimedia.org.

Lowering priority since this is rare and isn't happening when the correct language code is used. It would be nice to show japanese translations in the case jp gets used in a link accidentally, but seems to be tricky.

Let's continue to look elsewhere for the source of unintended recurrings.

Pcoombe renamed this task from JP form: add translations for One time/Monthly, Other, and Amount to JP form: add translations for One time/Monthly, Other, and Amount when uselang=jp.Sep 9 2020, 4:32 PM

Thanks @Pcoombe I'm going to check w/Kris about how the URL surfaced, and also look into the donation sources for the recent JP unintended recurrings

Hi all, in my keenness to scribe my very first Phab comment, just sharing a response below that I just shared in another chat in the hope it offers context...

"That particular URL populated in my browser and I wish I knew how it came to be. Donors often feed URL's back to me in Zendesk when reporting errors and the like.
Now that we know via Peter that it certainly doesn't stem from the WMF, perhaps this rogue link is around the traps from the past in error, e.g. a well intentioned donor has been sharing the URL on social media after tweaking a 'unselang=en' link and it is doing the rounds. I am stumped.
Either way, it sounds like we are back to square one with solving the recurring problem. I might set aside some time today to review the initial Japanese cancel requests from a week ago to see if donors dropped any tiny hints in their language used that we missed. Will this help? I will share if I find anything. Thanks all, Kris
"

I looked up donation sources for a dozen, 7 had upsell-related UTM keys. @Pcoombe I can scan more, or try to get browser details for these donors, if that is useful.

dateticket #order IDdonation campaign source from CiviUTM sourceUTM key
9/4/20207949487000808414C2021_jaJP_m_FRB2021_0901_jaJP_m_p1_lg_txt_cnt.no-LP.rccotherAmt_0~vw_360~vh_568~time_251
9/3/20207944357000819010C2021_jaJP_m_FRB2021_0901_jaJP_m_p2_sm_txt_19.no-LP.rccotherAmt_1~vw_375~vh_553~time_18
9/2/202079273090148148.1C2021_jaJP_dsk_FRB2021_0901_jaJP_dsk_p1_lg_txt_cnt.no-LP.rccotherAmt_0~ptf_1~vw_1920~vh_969~time_44
9/2/202079273190155591.1C2021_jaJP_m_FRB2021_0901_jaJP_m_p1_lg_txt_19.no-LP.rccotherAmt_1~monthlyUpsell_1~originalAmt_300~vw_360~vh_616~time_41
9/2/202079278790170435.1C2021_jaJP_m_FRB2021_0901_jaJP_m_p1_lg_txt_cnt.no-LP.rccotherAmt_1~monthlyUpsell_1~originalAmt_300~vw_375~vh_627~time_27
9/2/202079278890165055.1C2021_jaJP_m_FRB2021_0901_jaJP_m_p1_lg_txt_cnt.no-LP.rccotherAmt_1~monthlyUpsell_1~originalAmt_300~vw_375~vh_749~time_151
9/2/202079279890158380.1C2021_jaJP_dsk_FRB2021_0901_jaJP_dsk_p1_lg_txt_19.no-LP.rpaypalclickedNag_1~otherAmt_1~monthlyUpsell_1~originalAmt_300~vw_1112~vh_722~time_196
9/2/202079280890174859.1C2021_jaJP_dsk_FRB2021_0901_jaJP_dsk_p1_lg_txt_19.no-LP.rccotherAmt_0~ptf_1~vw_1157~vh_619~time_90
9/2/202079282290179718.1C2021_jaJP_m_FRB2021_0901_jaJP_m_p1_lg_txt_cnt.no-LP.rccotherAmt_0~changedAmt_1~ptf_1~vw_375~vh_628~time_103
9/8/202079811090724454.1C2021_jaJP_dsk_FRB2021_0908_jaJP_dsk_p1_lg_txt_cnt.no-LP.rccotherAmt_1~monthlyUpsell_1~originalAmt_300~vw_1440~vh_789~time_35
9/9/202079750590699427.1C2021_jaJP_m_FRB2021_0908_jaJP_m_p2_sm_txt_vol.no-LP.rccclickedNag_1~otherAmt_1~changedAmt_1~monthlyUpsell_1~originalAmt_300~vw_414~vh_719~time_121
9/9/202079747890695618.1C2021_jaJP_m_FRB2021_0908_jaJP_m_p1_lg_txt_cnt.no-LP.rccotherAmt_1~monthlyUpsell_1~originalAmt_300~vw_375~vh_768~time_174

These are from Zendesk tickets where donors are pretty insistent that they chose 'one time' in the donation form:

dateticket #order IDdonation campaign sourceUTM sourceUTM keycidnote
09/07/2079624590636939.1C2021_jaJP_dsk_FRB2021_0904_jaJP_dsk_p1_lg_txt_2per.no-LP.rccotherAmt_0~vw_1280~vh_578~time_10145952758
09/07/2079648690645496.1C2021_jaJP_m_FRB2021_0904_jaJP_m_p1_lg_txt_use.no-LP.rpaypalotherAmt_1~monthlyUpsell_1~originalAmt_300~vw_375~vh_628~time_3445958370
n/a796024n/an/an/an/a45938706no transaction; donor says PayPal initiated recurring?
09/07/2079598090613138.1C2021_jaJP_m_FRB2021_0904_jaJP_m_p1_lg_txt_cnt.no-LP.rccotherAmt_1~validateError_1~monthlyUpsell_1~originalAmt_300~vw_360~vh_616~time_3445938521
09/06/2079576490577568.1C2021_jaJP_m_FRB2021_0904_jaJP_m_p1_lg_txt_use.no-LP.rccotherAmt_1~ptf_1~vw_360~vh_559~time_140~monthlyUpsell_1~originalAmt_30045922159
09/06/2079583190588923.1C2021_jaJP_dsk_FRB2021_0904_jaJP_dsk_p1_lg_txt_cnt.no-LP.rccotherAmt_1~monthlyUpsell_1~originalAmt_300~vw_1366~vh_588~time_9345927411
09/05/2079564690558201.1C2021_jaJP_dsk_FRB2021_0904_jaJP_dsk_p1_lg_txt_cnt.no-LP.rccotherAmt_1~monthlyUpsell_1~originalAmt_300~vw_1389~vh_688~time_13045913409
09/03/2079497890419392.1C2021_jaJP_m_FRB2021_0903_jaJP_m_p2_sm_txt_cnt.no-LP.rccclickedNag_1~otherAmt_1~monthlyUpsell_1~originalAmt_300~vw_414~vh_852~time_3645848371
This comment was removed by MBeat33.
MBeat33 renamed this task from JP form: add translations for One time/Monthly, Other, and Amount when uselang=jp to Investigate Japanese unintended recurring donations.Sep 11 2020, 2:00 PM

Thanks for this @MBeat33 ... do you know (or perhaps Peter does):

"otherAmt_1~monthlyUpsell" ... does this mean the donor used one of the "Other" amount field in the main form, or the "Other" field in the MC form?

Or does *every* MC donation have that specific UTM tag?

I'm not sure what the UTM keys & tags mean in practice, @TSkaff

Hey @TSkaff and @MBeat33,

From my understanding those utm keys & tags indicate a sequence of actions that were taken, and 0 means False and 1 means True, so for example: otherAmt_1~monthlyUpsell_1~originalAmt_300~vw_375~vh_6 would mean the donor first entered a custom amount to donate in the banner, then selected the Yes I'll make a monthly donation, and their original donation amount was 300 (vw and vh are probably something to do with width and height but not sure what those variables mean).

We discussed this in a meeting and decided it would be a good idea to tag the monthly other option when that's selected...since it appears that's what might be causing some confusion here.

It may also be worth testing changing the colors of the buttons, so that it's more clear to users which option is selected.

Thanks for bringing this to our attention @KHancock99!

@MBeat33 @krobinson We've made quite a few changes since this task, including to clarify monthly convert buttons. Do you feel like we still saw an unusual number of unintended recurrings in the more recent Japan campaigns? Or can we close this?

AKanji-WMF claimed this task.
AKanji-WMF added subscribers: SHust, AKanji-WMF.

Tx @Pcoombe - according to @SHust we're good to close!