Page MenuHomePhabricator

Create Tracking Report: New Editors Thank You Campaign 2019/2020
Closed, ResolvedPublic

Description

We will reuse the landingpage we used in our last campaigns:

landingpage link
https://de.wikipedia.org/wiki/Wikipedia:Wikimedia_Deutschland/LerneWikipedia

During the thank you campaign, two different banners (Fundraising banner + Community Engagement banner) will be displayed. This ticket refers to the tracking of the Community Engagement banner only.

With regard to Community Engagement and technically speaking, three different banners will need to be tracked (Desktop, mobile, Ipad).

Banner NameCampaign Tag
WMDE_2019_2020_thx_dskt_ctrlWMDE_2019_2020_thx_dskt_ctrl
WMDE_2019_2020_thx_ipad_ctrlWMDE_2019_2020_thx_ipad_ctrl
WMDE_2019_2020_thx_mob_ctrlWMDE_2019_2020_thx_mob_ctrl

A/B Test

Banner NameCampaign Tag
WMDE_2019_2020_thx_dskt_varWMDE_2019_2020_thx_dskt_var
WMDE_2019_2020_thx_ipad_varWMDE_2019_2020_thx_ipad_var
WMDE_2019_2020_thx_mob_varWMDE_2019_2020_thx_mob_var

Campaign Tag additional link (the link will be placed in both A as well as B banner):
WMDE_2019_2020_thx_link_dskt_ctrl
WMDE_2019_2020_thx_link_ipad_ctrl
WMDE_2019_2020_thx_link_mob_ctrl
WMDE_2019_2020_thx_link_dskt_var
WMDE_2019_2020_thx_link_ipad_var
WMDE_2019_2020_thx_link_mob_var

Detailed tracking information you can find in this doc.

Campaign start: 01.01.2020

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptDec 10 2019, 4:49 PM

@Janina_Ottma_WMDE If and when you update the tracking info for this campaign, please do not forget to update the description of T240351. Otherwise we might run into confusion. Thank you.

@GoranSMilovanovic thanks for letting me know (this is my first time working with Phabricator, so sorry in advance for any future mistakes - I am still learning).
I have three questions:

  1. I would like the registrations via the different devices (mobile, Ipad, desktop) to be tracked. Do I need to change the respective campaign tags to do so?
  2. Do you need any further information/is there anything missing in the tracking concept or here that would be important for you to successfully track the campaign?
  3. Do you need a briefing call with me or are you okay with the written concept + the tasks here?

this is my first time working with Phabricator, so sorry in advance for any future mistakes - I am still learning

No worries, I will help in the process.

I would like the registrations via the different devices (mobile, Ipad, desktop) to be tracked. Do I need to change the respective campaign tags to do so?

To track the campaign pageviews, no, but to track user registrations (and user edits, consequently), yes.

Do you need any further information/is there anything missing in the tracking concept or here that would be important for you to successfully track the campaign?

No unless anything changes (the campaign tags to track registrations from different devices, perhaps).

Do you need a briefing call with me or are you okay with the written concept + the tasks here?

A briefing call before the campaign is always welcome, while the campaign test is necessary.

Janina_Ottma_WMDE added a comment.EditedDec 13 2019, 3:55 PM

Hi @GoranSMilovanovic! I edited the task description as we want to track registrations and views from different devices, do an A/B test and also want to include an additional link in the banner body. Please track the number of registrations via this link per device (daily and overall running time).

Please also note the updated required data (daily and overall running time) as stated in the tracking concept:

  • banner impressions
  • banner klicks
  • banner expansion klicks
  • closing quote of the banner
  • landing page views per device (desktop, mobile, Ipad)
  • registrations per device (desktop, mobile, Ipad)
  • registration through click on additional link in banner content area
  • edits of new users (after the campaign)
  • training modules - number of starters, closing (exit points) / completion rate

I will send you a briefing call invitation at the beginning of next week.

@Janina_Ottma_WMDE At this point, your tracking definitions are completely unclear.

Please schedule a call so that we can discuss what really needs to be done here. Thank you.

As of the following:

Please also note the updated required data (daily and overall running time) as stated in the tracking concept:

  • banner impressions - we can track this, Ok
  • banner klicks - I am not sure if the schema for this is ready, please contact @Tim_WMDE @Addshore @awight
  • banner expansion klicks - I am not sure if the schema for this is ready, please contact @Tim_WMDE @Addshore @awight
  • closing quote of the banner - I am not sure if the schema for this is ready, please contact @Tim_WMDE @Addshore @awight
  • landing page views - we can track this, Ok
  • landing page views per device (Desktop, mobile, Ipad) - we can track this, Ok
  • registrations through klick on button - how is this different from registrations in general - do you have a separate tag for this?
  • regsistration through klick on additional link in banner content area - how is this different from registrations in general - do you have a separate tag for this?
  • registrations per device (Desktop, mobile, Ipad) - how is this different from registrations in general - do you have a separate tag for this?
  • edits of new users (after the campaign) - we can track this, Ok
  • training modules - number of starters, closing (exit points) / completion rate - we can track this, Ok

I'm going to avoid looking at this unless poked again as I shouldn't really be working on this :)

@Addshore No worries you've been pinged only because you were involved in this banner actions thing in the previous campaign.
Ping: @Tim_WMDE @awight Please, gentlemen - we need to see what exactly about banners we can learn and from what schema. Thank you.

@GoranSMilovanovic

banner klicks - I am not sure if the schema for this is ready.

Like in the past campaigns, we assume that requests to the landing page using any of the campaign tags above are banner clicks.

banner expansion klicks - I am not sure if the schema for this is ready.
closing quote of the banner - I am not sure if the schema for this is ready.

Just like for fundraising banners, we will use Schema:WMDEBannerEvents for this. The fields slidesShown and finalSlide are not relevant and will contain 0.

registrations through klick on button - how is this different from registrations in general - do you have a separate tag for this?
registration through klick on additional link in banner content area - how is this different from registrations in general - do you have a separate tag for this?
registrations per device (Desktop, mobile, Ipad) - how is this different from registrations in general - do you have a separate tag for this?

As defined above, the different platforms will use different campaign tags (dskt, ipad, mob for devices). The targets of the links in the text will also use a different campaign tag (_link_).

@kai.nissen And you're finally back - thank you very much for the clarifications in T240361#5744403 and welcome!
@Janina_Ottma_WMDE More or less I think I get the tracking of the campaign right, let's discuss the details in our forthcoming call.

Hi @GoranSMilovanovic, got the missing details you requested from @kai.nissen:

  1. the single campaign tag ( ?campaign=WMDE_2019_2020_thx) is not neccessary as device-specific tags are used.
  2. banner clicks and button clicks are tracked in the same way - both are tracked as requests to the landing page using any of the campaign tags. this means that there is no distinction tracking-wise between the two. clicks on the additional link in the banner body will need to be tracked seperately as stated above.

I will respectively update the initial task/tracking concept now.

Additionally,

  1. @tmletzko asked, whether you could post your daily tracking reports here? (I also think that this is a good idea as it would ensure that all parties involved are up-to-date.)
  2. Can you please ping me here/send a link via email as soon as the setup is ready so that we can start testing?

thank you very much!

@Janina_Ottma_WMDE To put it in a nutshell: we can begin testing on Monday, December 23.

@GoranSMilovanovic I just created some accounts using the implemented banners. Can you check if everything works as expected?

@kai.nissen There were six (6) user registrations from the following banners on 2019/12/30:

  • WMDE_2019_2020_thx_dskt_ctrl
  • WMDE_2019_2020_thx_link_dskt_var
  • WMDE_2019_2020_thx_link_ipad_ctrl
  • WMDE_2019_2020_thx_dskt_var
  • WMDE_2019_2020_thx_link_dskt_ctrl
  • WMDE_2019_2020_thx_ipad_ctrl.

@GoranSMilovanovic @Janina_Ottma_WMDE fyi: the ty-campaign got disabled yesterday at 6 pm.