Page MenuHomePhabricator
Create Task
Maniphest T112172

EPIC: of epics Wikipedia.org Portal UX tests to run
Closed, ResolvedPublic
Actions

Description

An umbrella for series of small UX tests we want to run on Wikipedia.org page. Here is a related presentation deck: https://docs.google.com/a/wikimedia.org/presentation/d/1_RkkHqHGS2IABvCVcUWO4qKQqsyPdJq7_Y2gwYXRIYI/edit?usp=sharing /

Small UX tests on wikipedia.org.pdf1 MBDownload

We've compiled documentation around Wikipedia.org Portal Improvements project here: https://www.mediawiki.org/wiki/Wikipedia.org_Portal_Improvements

Also there is some information about our research plans for the project here: https://meta.wikimedia.org/wiki/Research:Portal_experiments

Related Objects
Search...

StatusSubtypeAssignedTask
 DuplicateNoneT110071 Add event-logging to www.wikipedia.org page
 ResolveddebtT112172 EPIC: of epics Wikipedia.org Portal UX tests to run
 ResolveddebtT112173 EPIC: [Portal A/B test 1]: Change the size of search text field and search button on Wikipedia.org
 DuplicateNoneT115928 Add EventLogging to current wikipedia.org portal page
 ResolvedIronholdsT116325 Decide what actions we want to record on the www.wikipedia.org portal
 Resolved• JGiraultT115960 [PAB1] Deploy A/B test (DUE Nov 23)
 ResolvedJdrewniakT117098 Implement schema for portal A/B tests and background data
 Resolved• JGiraultT115957 [PAB1] Actual code to change size of portal text box/button, inactive except during future A/B testing (DUE Nov 23)
 Resolved• JGiraultT117593 [PAB1] Discuss how we can have flags to turn on/off A/B test
 Resolved• JGiraultT118894 Make a task that generates wikipedia.org portal page based on a stats file
 ResolvedMaxSemT117799 Create a script to update portals based on stats
 Invalid• Ironholds_backupT115961 [PAB1] (Analysis) Verify, a day later, that the Portal A/B test is running properly
 Invalid• Ironholds_backupT115962 [PAB1] (Analysis) Analyse results of Portal A/B test after it's finished
 Resolved• csteippT117512 Give security a heads-up about plans and scripts to deploy wikipedia.org portal from gerrit
 Resolved• MSyedT117513 Work with Community Liaisons to make sure the switch of portal deployment to gerrit is properly announced
 Resolved• MSyedT117511 Choose a target date for the switch to deploy the wikipedia.org portal from gerrit
 ResolvedMaxSemT117515 Populate the gerrit portal repository with code for all the portals (DUE Nov 12)
 ResolvedMaxSemT115964 Prepare for deployment of existing portal from the portals repository
 DuplicateNoneT115949 Move the www.wikipedia.org portal to Git/Gerrit
 ResolvedKeeganT110070 Investigate moving the www.wikipedia.org portal to Git/Gerrit
 ResolvedEBernhardsonT113288 Fix permissions for wikimedia/portals
 ResolvedSmalyshevT115626 Set up staging area (beta) running the new portal repository
 Duplicate• MSyedT115955 Set up wiki page explaining upcoming UX changes
 Resolved• JGiraultT118019 Final re-sync of portals from meta to gerrit (DUE Nov 12)
 Resolved• JGiraultT118021 Deploy all portals from gerrit (for the first time) (DUE Nov 12)
 ResolvedJdrewniakT118023 Verify that new portal Event Logging is happening correctly (DUE Nov 16/17)
 Resolved• JGiraultT118022 Deploy wikipedia.org portal code that has Event Logging (DUE Nov 16)
 ResolvedNoneT120269 [PAB1] Describe upcoming portal A/B test
 Resolved• JGiraultT121425 [PAB1] Disable search box A/B test on or after 2015-12-14
 DuplicateNoneT112206 [EPIC] Change the size of search text field and make search button more prominent on wiki (not on Portal page)
 ResolveddebtT112209 EPIC: [Portal A/B/C test 2]: Make search type-ahead better with image and wikidata description on Wikipedia.org
 ResolvedJdrewniakT121023 [PAB2] Actual code to improve typeahead on portal, inactive except during future A/B testing
 ResolvedJdrewniakT121024 [PAB2] Deploy A/B test
 DuplicateJdrewniakT121025 [PAB2] (Analysis) Verify, a day later, that the Portal A/B test is running properly
 DuplicateJdrewniakT121026 [PAB2] (Analysis) Analyse results of Portal A/B test after it's finished
 InvalidJdrewniakT121027 [PAB2] Describe upcoming portal A/B test
 ResolvedIronholdsT122039 Document relaunched Portal A/B test
 ResolvedIronholdsT121701 Check data validity of the relaunched Portal A/B test on 2016-01-12/13
 ResolvedIronholdsT121566 Analyse the results of the Portal search box A/B test on or after 2016-01-21
 Resolved• JGiraultT124245 [PAB2] Disable A/B/C test
 DeclinedNoneT112211 [EPIC] Make search type-ahead better with image and wikidata description on wiki (not on Portal page)
 ResolvedJdrewniakT112212 EPIC: [Portal A/B test X]: Collapse Wiki-links on Wikipedia.org to move search textbox above.
DeclinedJdrewniakT112213 EPIC: [Portal A/B test X]: Collapse language wiki links
 ResolveddebtT121567 [EPIC] [PAB3] Build A/B test for language detection on the Portal to reorder and resort the primary links on the page to suit the user better
 ResolvedJdrewniakT124116 [PAB3] Disable / turn off testing for Portal lang detection preferences
ResolvedmpopovT124115 [PAB3] Analyze the results of the third portal A/B test
 ResolvedmpopovT124114 [PAB3] Check that all is well with the third portal A/B test
 ResolveddebtT124112 [PAB3] Deploy the Portal lang detection preferences test
 ResolvedJdrewniakT124111 [PAB3] Implement testing for Portal lang detection preferences
ResolvedNoneT124110 [PAB3] Specifications for lang detection on Portal
 ResolvedJdrewniakT128538 Log all user preferred languages instead of just one
 ResolvedJdrewniakT124486 Localized language for "The Free Encyclopedia" under Wikipedia header

Event Timeline

• MSyed created this task.Sep 10 2015, 8:52 PM
• MSyed raised the priority of this task from to Needs Triage.
• MSyed updated the task description. (Show Details)
• MSyed added projects: Discovery-ARCHIVED, Epic.
• MSyed subscribed.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 10 2015, 8:52 PM
• ksmith moved this task from Needs triage to UX on the Discovery-ARCHIVED board.Sep 10 2015, 8:55 PM
• MSyed updated the task description. (Show Details)Sep 11 2015, 10:46 PM
• MSyed set Security to None.
bd808 mentioned this in T110070: Investigate moving the www.wikipedia.org portal to Git/Gerrit.Oct 20 2015, 4:25 PM
Glaisher subscribed.Oct 20 2015, 4:31 PM
• MZMcBride subscribed.Oct 21 2015, 12:00 AM

I can't access https://docs.google.com/a/wikimedia.org/presentation/d/1_RkkHqHGS2IABvCVcUWO4qKQqsyPdJq7_Y2gwYXRIYI/edit?usp=sharing. It probably needs its permissions adjusted.

• MZMcBride mentioned this in T112211: [EPIC] Make search type-ahead better with image and wikidata description on wiki (not on Portal page).Oct 21 2015, 12:03 AM

Where is the published policy for what is and is not appropriate when testing on Wikimedians?

matmarex subscribed.Oct 21 2015, 12:09 AM

I can access it. Here's a PDF:

Small UX tests on wikipedia.org.pdf1 MBDownload

matmarex updated the task description. (Show Details)Oct 21 2015, 12:09 AM
Krenair subscribed.Oct 21 2015, 12:16 AM
• MZMcBride added a comment.Oct 21 2015, 4:34 PM

I looked at the attached PDF this morning and everywhere I looked the "success criteria" and "what to measure" portions were blank. I'm not sure if this was intentional.

As I noted in T112213, these tasks must consider the existing brand unity we have between Wikipedia, Wiktionary, Wikinews, and others. If you look at https://www.wiktionary.org/ or https://www.wikinews.org/, there are obvious similarities. I'm pretty hesitant to see only Wikipedia change.

Legoktm subscribed.Oct 23 2015, 1:30 AM
• ksmith updated the task description. (Show Details)Oct 30 2015, 6:13 PM
• ksmith subscribed.Oct 30 2015, 6:17 PM
debt subscribed.Jan 20 2016, 8:21 PM
Restricted Application added a subscriber: StudiesWorld. · View Herald TranscriptJan 20 2016, 8:21 PM
debt closed subtask T112173: EPIC: [Portal A/B test 1]: Change the size of search text field and search button on Wikipedia.org as Resolved.Jan 20 2016, 9:40 PM
debt renamed this task from EPIC: Wikipedia.org UX tests to EPIC: of epics Wikipedia.org Portal UX tests to run.Jan 20 2016, 9:43 PM
debt triaged this task as High priority.
debt added a project: Discovery-Portal-Sprint.
debt added a subtask: T121567: [EPIC] [PAB3] Build A/B test for language detection on the Portal to reorder and resort the primary links on the page to suit the user better.
debt moved this task from Backlog to Needs code review on the Discovery-Portal-Sprint board.Jan 26 2016, 12:46 AM
debt moved this task from Needs code review to Design Work on the Discovery-Portal-Sprint board.Jan 28 2016, 5:25 PM
debt closed subtask T112209: EPIC: [Portal A/B/C test 2]: Make search type-ahead better with image and wikidata description on Wikipedia.org as Resolved.Jan 28 2016, 5:32 PM
Krinkle added a project: Wikimedia-Portals.Mar 23 2016, 8:05 PM
debt closed subtask T112213: EPIC: [Portal A/B test X]: Collapse language wiki links as Declined.Apr 7 2016, 3:46 PM
debt closed subtask T112206: [EPIC] Change the size of search text field and make search button more prominent on wiki (not on Portal page) as Declined.Apr 7 2016, 5:13 PM
debt closed subtask T121567: [EPIC] [PAB3] Build A/B test for language detection on the Portal to reorder and resort the primary links on the page to suit the user better as Resolved.Apr 26 2016, 4:59 PM
debt closed subtask T112211: [EPIC] Make search type-ahead better with image and wikidata description on wiki (not on Portal page) as Declined.Aug 9 2016, 11:01 PM
debt closed this task as Resolved.Aug 18 2016, 12:57 PM
debt claimed this task.
debt closed subtask T112212: EPIC: [Portal A/B test X]: Collapse Wiki-links on Wikipedia.org to move search textbox above. as Resolved.
debt moved this task from Design Work to Done on the Discovery-Portal-Sprint board.

Moving this to resolved - we've basically done already everything that the scope of this ticket was about

debt moved this task from Done to Completed on the Discovery-Portal-Sprint board.Aug 22 2016, 7:22 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL