Page MenuHomePhabricator

[PAB3] Implement testing for Portal lang detection preferences
Closed, ResolvedPublic13 Estimated Story Points

Description

The spec info is in T124110....go forth and do the thing that needs to be done, please. :) Please report back if any questions or something can't be done.

Event Timeline

debt raised the priority of this task from to High.
debt updated the task description. (Show Details)
debt added subscribers: Deskana, Aklapper, Ironholds and 2 others.
debt renamed this task from [PAB2] Implement testing for Portal lang detection preferences to [PAB3] Implement testing for Portal lang detection preferences .Jan 20 2016, 8:28 PM
debt set Security to None.

Change 273900 had a related patch set uploaded (by Jdrewniak):
i18n localized top links A/B test.

https://gerrit.wikimedia.org/r/273900

Slightly changed the test script to format results in a prettier way:

Screen Shot 2016-03-07 at 5.01.44 PM.png (433×417 px, 47 KB)

Great job @Jdrewniak nonetheless!

Change 276725 had a related patch set uploaded (by Jdrewniak):
i18n localized top links A/B test.

https://gerrit.wikimedia.org/r/276725

Change 273900 abandoned by Jdrewniak:
i18n localized top links A/B test.

Reason:
A new patch which is rebased on master has been submitted.

https://gerrit.wikimedia.org/r/273900

I approved and merged the patch.

My notes though: New styling looks okay on desktop now. However I am not a big fan of the mobile look... looks odd in my opinion:

  • too much concentrated at the top of the screen
  • a lot of white space within the top10 now.
  • font looks small with all the white space around

It is good for an A/B test, but in my opinion the overall style should be improved (sooner or later) for a better experience and even better user engagement.

Below a few screenshots to illustrate my notes:

Screen Shot 2016-03-17 at 12.10.25 PM.png (1×556 px, 392 KB)
Screen Shot 2016-03-17 at 12.11.42 PM.png (1×568 px, 423 KB)
Screen Shot 2016-03-17 at 12.12.26 PM.png (1×662 px, 399 KB)
Screen Shot 2016-03-17 at 12.13.41 PM.png (1×796 px, 583 KB)

It should be available for test on beta soon (automatic deploy).

Change 276725 merged by jenkins-bot:
i18n localized top links A/B test.

https://gerrit.wikimedia.org/r/276725

After deploying to the beta portal again (thanks, @EBernhardson!), I was able to view the A/B test. I agree with @JGirault's comments above - the spacing is a bit off, but it's good enough for a test to be run.

To test: http://www.wikipedia.beta.wmflabs.org/#language-detection-b (for the actual test - you might have to refresh the page once to see the new treatment).
http://www.wikipedia.beta.wmflabs.org/#language-detection-a is the same page as our original wikipedia.org.

@Jdrewniak - nice work! Let's push it live, when we can, starting the week of Tuesday, March 22, 2016! :)

I've included some screenshots of the responsive desktop treatment:

Chinese Simplified, Spanish, French (CA), English for my preferred browser languages (note the localized The Free Encyclopedia phrase under the wordmark)

Screen Shot 2016-03-18 at 3.39.41 PM.png (724×474 px, 145 KB)

Chinese Simplified, Spanish, French (CA), English for my preferred browser languages (desktop view of Spring Break search results while searching in EN)

Screen Shot 2016-03-18 at 3.46.29 PM.png (914×1 px, 321 KB)

Existing responsive treatment ("A" portion of the test)

Screen Shot 2016-03-18 at 3.57.50 PM.png (667×436 px, 119 KB)

Existing desktop treatment ("A" portion of the test)

Screen Shot 2016-03-18 at 3.58.06 PM.png (931×1 px, 238 KB)

Done and released on March 22, 2016