This ticket is to capture the work needed to be done to analyze the results of the A/B test for the languages by article count test.
Please see the epic ticket for further information: https://phabricator.wikimedia.org/T131526
This ticket is to capture the work needed to be done to analyze the results of the A/B test for the languages by article count test.
Please see the epic ticket for further information: https://phabricator.wikimedia.org/T131526
Progress update: https://github.com/wikimedia-research/Discovery-Portal-Test-SecondaryLinks
Interesting preliminary results: http://i.imgur.com/0uniZwq.png
As part of this analysis, I've released some additions to the BCDA package (https://github.com/bearloga/BCDA), namely making it better for reports: https://github.com/bearloga/BCDA#tabular-presentation-of-the-results
First draft of the report is up on GitHub now: https://github.com/wikimedia-research/Discovery-Portal-Test-SecondaryLinks/blob/master/report.pdf
If the draft jives with @debt & @TJones, I'll upload it to Commons. It's a pretty short one so reviewing shouldn't take too long :)
Hey @mpopov - this looks pretty good! I'll let @TJones and @Jdrewniak take a look at it as well before calling it completely done.
I've also uploaded a screen shot of the exec summary for those that don't want to click through and read the pdf.
The data gathered and analyzed shows that the cleaner page results in more actions taken, yay!
This looks really good to me. As always, all the included links are appreciated! The results seem pretty straightforward. We should do it!
Awesome! Thanks all! :D Final draft is up on Commons now: https://commons.wikimedia.org/wiki/File:Wikipedia_Portal_AB_Test_of_Collapsing_links_to_Wikipedia_in_other_languages.pdf