|Resolved||debt||T112172 EPIC: of epics Wikipedia.org Portal UX tests to run|
|Resolved||debt||T112209 EPIC: [Portal A/B/C test 2]: Make search type-ahead better with image and wikidata description on Wikipedia.org|
|Resolved||Ironholds||T121566 Analyse the results of the Portal search box A/B test on or after 2016-01-21|
Sure; the JS at the frontend wasn't actually collecting clickthroughs through the search box for the test group. In other words, everything was fine except for the one sort of data we absolutely couldn't do without :/. Accordingly we'll relaunch (with the bug fixed) on 4 january, possibly (still deciding) as part of an A/B/C test with the next iteration as well.
Here's a copy of the email @Ironholds sent out about this testing effort:
From: Oliver Keyes <email@example.com>
Date: Thu, Jan 28, 2016 at 4:44 AM
Subject: [discovery] Portal A/B test results available
To: A public mailing list about Wikimedia Search and Discovery projects <firstname.lastname@example.org>
A couple of weeks ago we ran an A/B test on the Wikipedia portal
(www.wikipedia.org) to test whether a more prominent search box,
optionally combined with additional metadata such as small images in
the search results, would increase the rate at which people clicked
through from the portal to one of our projects.
We are delighted to say that the test showed a 1-5% increase in the
clickthrough rate, where both a prominent search box and metadata is
used. Accordingly, once we've resolved concerns about the design's
The report can be seen at
https://commons.wikimedia.org/wiki/File:First_Portal_Test.pdf - please
let me know if you have any questions.
For Discovery Analytics,