Page MenuHomePhabricator

Create Tracking Report: New Editors Thank You Campaign 2019
Closed, ResolvedPublic

Description

We will reuse the landingpage we used in our last campaigns:

landingpage link
https://de.wikipedia.org/wiki/Wikipedia:Wikimedia_Deutschland/LerneWikipedia

campaign tag
There will be 2 (identical) banners with just different messages. One message will adress getting new editors. This Link to the New Editors Landing Page should contain the following campaign tag:
Banner: ?campaign=WMDE_2019_thx (banner text to learn wikipedia)

The campaign tag is the same in both banners, the banner names slightly differ by a suffix:

Banner NameCampaign Tag
WMDE_2019_thx_dskt_ctrlWMDE_2019_thx
WMDE_2019_thx_dskt_varWMDE_2019_thx
WMDE_2019_thx_ipad_ctrlWMDE_2019_thx
WMDE_2019_thx_ipad_varWMDE_2019_thx
WMDE_2019_thx_mob_ctrlWMDE_2019_thx
WMDE_2019_thx_mob_varWMDE_2019_thx

landingpage including the campaign tag
Banner: https://de.wikipedia.org/wiki/Wikipedia:Wikimedia_Deutschland/LerneWikipedia?campaign=WMDE_2019_thx

Detailed Tracking Information you can find in this doc.

Campaign start: 01.01.2019

Event Timeline

Stefan_Schneider_WMDE renamed this task from Tracking: New Editors Thank You Campaign 2019 to Create Tracking Report: New Editors Thank You Campaign 2019.Nov 30 2018, 11:14 AM
Stefan_Schneider_WMDE updated the task description. (Show Details)

@kai.nissen Hi Kai, am I right, that you are involved in creating the thank you campaign banners? If so, please take this tracking information into account for the links to your landing page. I appreciate a feedback, if I am right.

@Stefan_Schneider_WMDE Yes, I will be preparing this joint banner campaign for technical implementation.

Hello @kai.nissen,
just a quick heads up for the tracking of the Thank You Campaign: Stefan is ill till christmas so I will take over the tracking task from our side. So let me know, if you need anything! It would be great if a test banner was ready in the middle of next week so we can do one test run with a sample registration before the holidays. I talked to Till about it and it should be doable, he has added it to your Jour Fixe I think :-) but please get in contact if you have any questions or objections.

@kai.nissen Hi Kai, I am sorry to hear you are ill. Till told me that you are now planning to create the banner on December 27. So Verena will do a test to see if the tracking works on December 28 and then check with Goran if everything works. Like this we have December 29 for last improvements if something doesnt't work. As you know, this is very important for our campaign. I'd appreciate a quick feedback (to Verena because I am on holidays) when you are back in office if this also works for you. Thank you!
@Verena

@Verena
Banner development started today. We can also set up a dummy banner for checking the landing page and account registration stuff, if that helps.

@Verena @kai.nissen @Christine_Domgoergen_WMDE

Please just ping me here when the test data are ready. Thanks.

@kai.nissen A dummy banner would be helpful, thank you.

The fundraising operations team wants to carry out an a/b test during this campaign (of course). Thus, this campaign will consist of two almost identical banners. The only difference is the target URL of the membership button.

@GoranSMilovanovic A while ago, we agreed on naming the banner and the campaign tag the same. I'm not sure what works best for you in this case. We have two options:

  • Use the same campaign tag, but have different/suffixed banner names.
  • Use different campaign tags for an exact match of banner and campaign names.

@Verena @Christine_Domgoergen_WMDE dummy banners are up:
WMDE_2019_thx_ctrl
WMDE_2019_thx_var

@kai.nissen

  • Use the same campaign tag, but have different/suffixed banner names.

and please provide exact tag semantics (this banner = this campaign), thanks.

BTW In my understanding, we track only the "non-fundraising" part of the campaign - @Christine_Domgoergen_WMDE is that right?

kai.nissen added a comment.EditedDec 21 2018, 4:30 PM

That's correct, @GoranSMilovanovic. The evaluation of the fundraising part of the campaign will be done by the fundraising operations team.

kai.nissen updated the task description. (Show Details)Dec 21 2018, 4:35 PM

@kai.nissen Ok then just please let me know what campaign banner/tag combination do we track.

@GoranSMilovanovic

I created a test account for each of the test banners below. Could you check, if they were registered by the tracking? Will be probably available tomorrow, right?

The fundraising operations team wants to carry out an a/b test during this campaign (of course). Thus, this campaign will consist of two almost identical banners. The only difference is the target URL of the membership button.

@GoranSMilovanovic A while ago, we agreed on naming the banner and the campaign tag the same. I'm not sure what works best for you in this case. We have two options:

  • Use the same campaign tag, but have different/suffixed banner names.
  • Use different campaign tags for an exact match of banner and campaign names.

@Verena @Christine_Domgoergen_WMDE dummy banners are up:
WMDE_2019_thx_ctrl
WMDE_2019_thx_var

@Verena I will do it during the day and then get back to you. Thank you for testing.

Could anyone please address my question in T210832#4840614 @kai.nissen @Christine_Domgoergen_WMDE @Verena @Stefan_Schneider_WMDE ?
Because I still do not understand which banner exactly will we track: WMDE_2019_thx_ctrl or WMDE_2019_thx_var - and as far as I understand we will be tracking only one of them, while the fundraising team will be concerned with the other one. Please advise. Thank you.

@GoranSMilovanovic Both banners need to be tracked.

@kai.nissen Thanks Kai! @Verena testing today, then reporting here.

  • running tests as of 17:45 CET
GoranSMilovanovic added a comment.EditedDec 27 2018, 5:15 PM

@Verena @kai.nissen Kai I need your attention please

Test results:

  • banners: no banner impressions recorded from the following parameters:
uri_host <- c('de.wikipedia.org', 'de.m.wikipedia.org')
uri_path  <- '/beacon/impression'
uri_query <- c('WMDE_2019_thx_ctrl', 
               'WMDE_2019_thx_var'
               )
  • pageviews: several pageviews with our campaign tag were registered today:
/wiki/Wikipedia:Wikimedia_Deutschland/LerneWikipedia    ?campaign=WMDE_2018_sprbt1      -
/wiki/Wikipedia:Wikimedia_Deutschland/LerneWikipedia    ?campaign=WMDE_2018_sprbt1      -
/wiki/Wikipedia:Wikimedia_Deutschland/LerneWikipedia    ?campaign=WMDE_2019_thx http://localhost:8084/
/wiki/Wikipedia:Wikimedia_Deutschland/LerneWikipedia    ?campaign=WMDE_2019_thx http://localhost:8084/
/wiki/Wikipedia:Wikimedia_Deutschland/LerneWikipedia            -
/wiki/Wikipedia:Wikimedia_Deutschland/LerneWikipedia            -
/wiki/Wikipedia:Wikimedia_Deutschland/LerneWikipedia            -
/wiki/Wikipedia:Wikimedia_Deutschland/LerneWikipedia    ?campaign=WMDE_2019_thx https://de.wikipedia.org/?banner=WMDE_2019_thx_ctrl
/wiki/Wikipedia:Wikimedia_Deutschland/LerneWikipedia    ?campaign=WMDE_2019_thx http://localhost:8084/
/wiki/Wikipedia:Wikimedia_Deutschland/LerneWikipedia    ?campaign=WMDE_2019_thx https://de.wikipedia.org/?banner=WMDE_2019_thx_var
/wiki/Wikipedia:Wikimedia_Deutschland/LerneWikipedia            -
/wiki/Wikipedia:Wikimedia_Deutschland/LerneWikipedia    ?campaign=WMDE_2018_sprbt2      -
/wiki/Wikipedia:Wikimedia_Deutschland/LerneWikipedia    ?campaign=WMDE_2019_thx https://de.wikipedia.org/?banner=B18WMDE_ty01_190101_var
/wiki/Wikipedia:Wikimedia_Deutschland/LerneWikipedia    ?campaign=WMDE_2018_sprbt1      https://de.wikipedia.org/wiki/Timbuktu
/wiki/Wikipedia:Wikimedia_Deutschland/LerneWikipedia    ?campaign=wmde_etc2017_bt1      https://de.wikipedia.org/
  • user registrations: two test users registered:
"1",3098616,"Kampagnentest001",1,"WMDE_2019_thx",20181227102733,2018-12-27,"thankyou2018"
"2",3098617,"Kampagnentest002",1,"WMDE_2019_thx",20181227102839,2018-12-27,"thankyou2018"

@kai.nissen From the current tracking setup I can only tell if a pageview or an user registration act did or did not originate from the campaign (WMDE_2019_thx tag present, take a look at the data), but I cannot say if a pageview or a user registration happened after WMDE_2019_thx_ctrl or after WMDE_2019_thx_var. Please advise. Thank you.

@GoranSMilovanovic Telling the banners apart is not necessary in this context. The difference only affects the fundraising part of the campaign.

Very well. No further testing required. The campaign may start tomorrow, @kai.nissen Can you verify that?

The campaign will start on Jan 1.

@GoranSMilovanovic Due to the request of fundraising operations, there will be six (!) banners in three campaigns. For further banner name differentiation I will change the suffixes. This shouldn't affect evaluation on your side, apart from fetching banner impression numbers.

kai.nissen updated the task description. (Show Details)Dec 28 2018, 5:04 PM

@kai.nissen The daily reporting is linked from T211690.

Two years later, should this task still remain open (and its project tag active instead of archived)?

@Aklapper This should remain active for non campaign related reportings, but this one could be archived indeed: https://phabricator.wikimedia.org/project/view/4409/

@Christine_Domgoergen_WMDE: Thanks. In case of https://phabricator.wikimedia.org/project/view/4409/ its three open tasks first need sorting out :)

@Aklapper done :-) thanks for helping to tidy this up!