Page MenuHomePhabricator

State the tracking critera for the Autumn Banner Campaign 2017
Closed, ResolvedPublic

Description

Please state the following information in relation to the WDME Autumn Banner Campaign 2017 in a precise and exact manner:

  • The campaign tags to trace the banner impressions from wmf.webrequest.

(1) ?campaign=wmde_abc2017_bt1
(2) ?campaign=wmde_abc2017_bt2
(3) ?campaign=wmde_abc2017_bt3
(4) ?campaign=wmde_abc2017_gib_lp
(5) ?campaign=wmde_abc2017_gib_rg

  • The campaign tags to trace banner clicks from wmf.webrequest

(1) ?campaign=wmde_abc2017_bt1
(2) ?campaign=wmde_abc2017_bt2
(3) ?campaign=wmde_abc2017_bt3
(4) ?campaign=wmde_abc2017_gib_lp
(5) ?campaign=wmde_abc2017_gib_rg

  • The respective landing pages URLs; NOTE: this landing pages must be recognizable as referers in the referer field of the wmf.webrequest table to the Registration page.

[enlist all page URLs here, separated by a CR]

(bt1 - pictures/blue)
https://de.wikipedia.org/wiki/Wikipedia:Wikimedia_Deutschland/JetztMitmachen#Bebildern
(bt2 - articles/pink)
https://de.wikipedia.org/wiki/Wikipedia:Wikimedia_Deutschland/JetztMitmachen#Aktualisieren
(bt3 - sources/green)
https://de.wikipedia.org/wiki/Wikipedia:Wikimedia_Deutschland/JetztMitmachen#Belegen
(gib_lp - orange)
https://de.wikipedia.org/wiki/Wikipedia:Wikimedia_Deutschland/Mach_mit
(gib_rg - orange)
https://de.wikipedia.org/wiki/Spezial:Benutzerkonto_anlegen

Please do not link to other Phab tickets here. State the relevant campaign information here in a clear and precise manner.

Thank you.

Event Timeline

@Addshore The campaign tags in the tast description do not differ in tracking banner impressions OR banner cliciks, right?

@Stefan_Schneider_WMDE Thank you very much, Stefan. This really helps avoiding the confusion near the onset of the campaign.

The campaign tags to track banner impressions should not differ from any other campaign tags; I have separated them into two groups above just to remind you that they were different in the test phase and to make sure you will double-check everything (where suffixes "a", "b", "c", "d", and "e" were used). Again: thank you very much.

IMPORTANT

By making our users potentially land at thee different places in the https://de.wikipedia.org/wiki/Wikipedia:Wikimedia_Deutschland/JetztMitmachen page - depending upon the banner they click on - you have changed the campaign evaluation design. A question for you:

If (A), the campaign evaluation design needs to be changed; if (B), it does not.

Feedback, please, and thanks again.

@GoranSMilovanovic Thanks for being specific again.

I'll double check that with the team and get back to you latest on Thursday. I guess the answer is not time critical for the start of the campaign, but for the end of the campaign.

@Stefan_Schneider_WMDE Exactly. The structure of the dataset allows us to formulate any of the two versions of the research design and evaluate it. In fact, we can do both.

@Addshore The campaign tags in the tast description do not differ in tracking banner impressions OR banner cliciks, right?

Nope.

@Stefan_Schneider_WMDE Discard my question on the research design (whether we treated the Landing Page for bt1, bt2, bt3 as one and the same, or not). It does not introduce any relevant changes in the evaluation design.

Ok: introducing the changes in R and testing.

@Stefan_Schneider_WMDE @Addshore @kai.nissen

NOTE: no banner impressions can be retrieved for this campaign from the wmf.webrequest table; the following HiveQL query (which worked just fine for the Summer Banner Campaign)

`SELECT uri_query FROM webrequest
WHERE uri_host = 'de.wikipedia.org'
AND uri_path = '/beacon/impression'
AND year = 2017
AND month = 10
AND day = 5`

collects every banner impression from de.wikipedia.org, and then grepl() finds nothing with abc2017 there.

Banner name != Campaign name

{
  "http_status": "204",
  "http_method": "POST",
  "uri_host": "de.wikipedia.org",
  "uri_path": "\/beacon\/impression",
  "uri_query": "?country=DE&anonymous=true&project=wikipedia&db=dewiki&uselang=de&device=desktop&debug=false&randomcampaign=0.0029810286681392073&randombanner=0.38407824122234924&recordImpressionSampleRate=1&status=banner_shown&statusCode=6&campaign=C17_WMDE_Test_08&campaignCategory=fundraising&campaignCategoryUsesLegacy=true&bucket=1&bannersNotGuaranteedToDisplay=true&banner=B17WMDE_08_170928_var&bannerCategory=fundraising&alterFunctionMissing=true&result=show",
  "content_type": "-",
  "referer": "https:\/\/de.wikipedia.org\/wiki\/Wikipedia:Hauptseite"
}

Banner names can be found @ https://meta.wikimedia.org/w/index.php?title=Special:CentralNotice&subaction=noticeDetail&notice=WMDE_Editor_Fall_2017

The comment you have linked to talks explicitly about "campaign tags" not banner names.

It looks like what should actually be in the task description is "The BANNER NAMES to trace the banner impressions from wmf.webrequest." not "The campaign tags to trace the banner impressions from wmf.webrequest."

Well, I did have the following point, didn't I ...

  • The campaign tags to trace the banner impressions from wmf.webrequest.

Nevermind. The code is changed, running tests again.