| debt | |
| Sep 11 2017, 11:33 PM |
| F9730691: explore-similar-lang-links-test-graphs-of-actions.png | |
| Sep 22 2017, 7:35 PM |
| F9468875: explore_similar-test2_lang-link.jpg | |
| Sep 11 2017, 11:33 PM |
We'll be doing another test to investigate if and how many users click into the language link to see if the article is also written in a language (other than English) and then to see if the user wants to click through to that new article to read.
Write up is here: https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_Improvements/explore_similar#Explore_similar_-_for_languages_in_search_results
It'll look something like this:
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | Jdrewniak | T149809 [A/B Test] Add 'explore similar' pages, categories and suggested languages in search results | |||
| Resolved | Jdrewniak | T175647 Explore Similar Language Link A/B test | |||
| Resolved | Jdrewniak | T175648 Turn on test for language links | |||
| Resolved | Jdrewniak | T175649 Turn off test for language links | |||
| Resolved | • chelsyx | T175650 Language links A/B test: quick analysis |
This new test code will ride the train this week and be turned on Thursday, Sep 14: https://gerrit.wikimedia.org/r/#/c/376508/ and https://gerrit.wikimedia.org/r/#/c/376509/
The analysis is done for the running of this test and unfortunately, we only had one clickthrough to an article written in a different language (which was displayed in the new language links) as the report documents. We will not be going forward with this feature.
However, if a user wants to have the language link script added to their logged-in account, please follow the instructions here: https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_Improvements/explore_similar#Explore_similar_-_for_languages_in_search_results.
The full explore similar script (displays related articles, categories and language links) can also be enabled for logged-in users, see this link for instructions: https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_Improvements/self-guided_testing#Explore_similar
Breakdown of events during this 7 day test cycle on English Wikipedia, taking into account that these numbers are only a bucketed sampling of all users that saw a SERP page during this test:
| Language link was clicked on to display list of the same article but written in a different language | clickthrough to same article written in a different language | % |
| 70 | 1 | 0.14% |
| Total SERPs control group | SERP w/sis project sidebar | % | clickthrough to sis project | % |
| 1,645 | 1,211 | 73.62% | 9 | 0.74% |
| Total SERPs test group | SERP w/sis project sidebar | % | clickthrough to sis project | % |
| 1,594 | 1,198 | 75.16% | 3 | 0.25% |
| Total SERPs control group | clickthrough to article | % |
| 1,645 | 532 | 32.34% |
| Total SERPs test group | clickthrough to article | % |
| 1,594 | 433 | 27.16% |
Data Summary graph:
