Page MenuHomePhabricator

Banner Test Desktop 07: Campaign Setup
Closed, ResolvedPublic1 Estimated Story Points

Description

Campaign settings below mostly match the docs in the infrastructure wiki, exceptions are displayed in bold.

Campaign

Preceded bySucceeded by
T202858C18_WMDE_Test_07T205102

Banners

Banner nameRespective page on meta-wikiLink to example on production wiki
B18WMDE_07_181004_ctrlsetuppreview
B18WMDE_07_181004_varsetuppreview

Campaign settings

General

NameC18_WMDE_Test07
Start Date2018-10-04
Start Time12:00 UTC
End Date2018-10-18
End Time12:00 UTC
ProjectsWikipedia
Languagesde - German
GeotargetedGermany
User bucketing2
Priorityhigh
Limit traffic2%

Extra features

Legacy hiding and impression counting support

Set sample rate
Sample rate1
Banners might not display

Impression diet

Identifierwmde-precampaign-2018
Skip impressions0
Max impressions10
Wait time0

Banner settings

Categoryfundraising
Display toAnonymous users
Display ondesktop

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript
kai.nissen set the point value for this task to 1.Sep 7 2018, 9:30 AM

@Tonina_Zhelyazkova_WMDE Oct 4th is the scheduled start date. I just changed the description accordingly.

@Tonina_Zhelyazkova_WMDE @kai.nissen
I found a bug in both banners. On firefox (windows 10, firefox quantum 60.2.1esr) on smaller view ports the donation form overlays the banner text. On chrome everything is fine.

It looks like this:

image.png (444×1 px, 135 KB)

@Tobias_Schumann_WMDE this is fixed for campaign 08, so I applied that fix for 07 as well.
If you test the banner on the German wikipedia for example, you shouldn't see the problem anymore.
It still appears on the metawiki though and I'm not sure why. Probably some weird caching.

@Tonina_Zhelyazkova_WMDE the test can start today as planned (yesterday I wrote @gabriel-wmde that I was hesitating because of the number of donations in the current test), but can you please change the tracking codes to todays date? Thanks!

And one question: When I made test donations (in private mode on firefox) I got the landing page variant of test 6 (no scroll, opt-in moved, no sub-heading). Was that implemented or is it a cache thing of my browser? Actually we did not yet decide if we will go on with var of test 6, but if it is implemented that way it's ok, I could live with it for test 7.

@Tobias_Schumann_WMDE just updated the tracking codes to today.
The cookie we write for the a/b test is not cleared when you close the tab, it is destroyed when the a/b test expires. That is why you still see the a/b test stuff of campaign 06 even though you used the 07 banner.
Exactly when test 07 is supposed to start, the usability a/b test will end. So from 14:00 onwards you're not supposed to see the landing page variant of test 06.

Test 06 was about passing a url parameter which tells the Fundraising Application which group of users you get into (the ones that see the landing page changes or not).
So, practically for test 07, it didn't matter which banner we use.