Page MenuHomePhabricator
Create Task
Maniphest T238887

[EPIC] Growth: Homepage variant tests
Closed, ResolvedPublic
Actions

Description

This epic will collect all variant tests the Growth team will run on the newcomer homepage, including the newcomer tasks feature.

The experiment design we will use for running tests is described here: T235933: Variant tests: A/B/C testing capability

For more explanation of variant testing, see this page.

Details

SubjectRepoBranchLines +/-
Homepage: Check welcome notice seen preferencemediawiki/extensions/GrowthExperimentswmf/1.36.0-wmf.34+4 -0
Homepage: Check welcome notice seen preferencemediawiki/extensions/GrowthExperimentsmaster+4 -0
Remove variant A codemediawiki/extensions/GrowthExperimentsmaster+28 -206
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedMMiller_WMFT238887 [EPIC] Growth: Homepage variant tests
 ResolvedkostajhT235933 Variant tests: A/B/C testing capability
 ResolvedCatropeT232396 Variant tests: align treatment groups
 ResolvedCatropeT240920 Variant tests: turn on help panel for homepage people
 Resolvednettrom_WMFT238888 Variant tests: "initiation" test (A vs. B)
 Resolvednettrom_WMFT253902 Variant tests: revisit edit completion for A vs. B
 ResolvedCatropeT254413 Variant tests: switch all newcomers to Variant A
 ResolvedRHoT246533 Variant tests: "initiation part 2" test (C vs. D)
 Resolved• mewophT223221 Newcomer tasks: unactivated state of impact module should drive newcomer tasks
 Resolved• mewophT274820 Newcomer tasks: unactivated state of the mobile preview of the impact module should drive newcomer edits
 ResolvedMMiller_WMFT250331 Variant tests: C-desktop
 ResolvedMMiller_WMFT250343 Variant tests: D-desktop
 ResolvedkostajhT258005 Variant C/D: homepage layout changes
 ResolvedkostajhT258704 Variant C/D: homepage Suggested edits module changes - Desktop
 ResolvedkostajhT262032 Variant C/D: homepage Suggested edits module changes - Mobile
 DeclinedNoneT262168 Variant C/D: fix overflow in impact module
 ResolvedTgrT264462 [Leftovers] Newcomer homepage: Visual design improvements to the homepage layout on Desktop
 ResolvedCatropeT264636 [Leftovers] Newcomer homepage: Visual design improvements to the Suggested edits module on Desktop
 ResolvedCatropeT258019 Variant D (desktop): embed onboarding dialog into suggested edits module
 ResolvedTgrT258009 Variant C/D: welcome popup on desktop
 ResolvedMMiller_WMFT250440 Variant tests: C-mobile
 ResolvedCatropeT258016 Variant C: onboarding
 ResolvedTgrT258020 Variant C: Info icon in suggested edits module
 ResolvedTgrT258021 Variant C/D: mobile preview for suggested edits module with first suggested edit
 ResolvedTgrT258024 Variant C/D: support consistent suggested edits queue
 ResolvedTgrT264087 Variant C/D: clicking content of task preview doesn't open suggested edits
 ResolvedSgsT264460 Enable users to open the first suggested article directly from the mobile task preview
 ResolvedCatropeT258023 Variant C: pre-initiate suggested edits module on account creation
 ResolvedkostajhT258652 Variant C/D: remove header from discovery banner on mobile
 ResolvedMMiller_WMFT250451 Variant tests: D-mobile
 ResolvedCatropeT258008 Variant C/D: smaller start module
 DeclinedNoneT258015 Variant D: welcome banner
 Resolved• mewophT258017 Variant D: difficulty overlay in onboarding
 ResolvedkostajhT258022 Variant D: mobile preview for suggested edits module with call to action
 ResolvedkostajhT258010 Variant C/D: welcome peek drawer on mobile
 ResolvedTgrT262485 Variant C/D: instrumentation
 OpenNoneT250455 Variants tests: C vs. D analysis
 OpenNoneT251458 Variant tests: C and D copy updates
 ResolvedTgrT263492 Variant tests: query string parameter
 ResolvedMMiller_WMFT264831 Variant tests: C vs. D analysis
 Declinednettrom_WMFT264832 Variant tests: monitoring dashboard for C vs. D
 ResolvedCatropeT265372 Variant C/D: configuration control
 ResolvedCatropeT265556 Variant tests: roll out variant C/D
 DeclinedBUG REPORTNoneT265427 [mobile] variant C - make transition between overlays smoother
 Declinednettrom_WMFT270747 Variant tests: C vs. D analysis followup: editing at registration
 Declinednettrom_WMFT270785 Variant tests: C vs. D analysis followup: connection with Welcome Survey responses
 ResolvedkostajhT272754 Variant tests: Create hybrid of Variant C / D
 DeclinedNoneT246875 Variant tests: feature suggested edits (E vs. F vs. G)
 OpenNoneT249637 Variant tests: mobile interaction entry point breakdown
 ResolvedkostajhT251477 Variant tests: explicitly store variant assignments
 ResolvedCatropeT264374 Variant C/D: convert legacy users to Variant D (and make it the default)
 ResolvedCatropeT265751 Variant C/D: autoscroll on Variant D
 ResolvedTgrT265754 Variant C/D: inconsistencies with welcome survey and discovery popups

Event Timeline

MMiller_WMF created this task.Nov 22 2019, 12:54 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 22 2019, 12:54 AM
MMiller_WMF claimed this task.Nov 22 2019, 12:54 AM
MMiller_WMF added a project: Epic.
MMiller_WMF edited projects, added Growth-Team (Sprint 0 (Growth Team)); removed Growth-Team.
MMiller_WMF moved this task from Incoming to Epics In Progress on the Growth-Team (Sprint 0 (Growth Team)) board.
MMiller_WMF added a subtask: T235933: Variant tests: A/B/C testing capability.
MMiller_WMF added a subtask: T232396: Variant tests: align treatment groups.Nov 22 2019, 1:01 AM
MMiller_WMF updated the task description. (Show Details)Nov 22 2019, 1:11 AM
MMiller_WMF closed subtask T232396: Variant tests: align treatment groups as Resolved.Dec 13 2019, 11:55 PM
MMiller_WMF added a subtask: T246533: Variant tests: "initiation part 2" test (C vs. D).Mar 1 2020, 9:18 PM
MMiller_WMF closed subtask T238888: Variant tests: "initiation" test (A vs. B) as Resolved.Apr 3 2020, 4:49 PM
MMiller_WMF added a subtask: T249637: Variant tests: mobile interaction entry point breakdown.Apr 7 2020, 7:06 PM
Etonkovidova closed subtask T251477: Variant tests: explicitly store variant assignments as Resolved.Jul 23 2020, 9:26 PM
Etonkovidova closed subtask T265751: Variant C/D: autoscroll on Variant D as Resolved.Oct 22 2020, 5:03 PM
MMiller_WMF closed subtask T264374: Variant C/D: convert legacy users to Variant D (and make it the default) as Resolved.Nov 2 2020, 6:13 AM
gerritbot added a comment.Dec 18 2020, 7:02 PM

Change 650558 had a related patch set uploaded (by Kosta Harlan; owner: Kosta Harlan):
[mediawiki/extensions/GrowthExperiments@master] Remove variant A code

https://gerrit.wikimedia.org/r/650558

gerritbot added a project: Patch-For-Review.Dec 18 2020, 7:02 PM
MMiller_WMF closed subtask T265754: Variant C/D: inconsistencies with welcome survey and discovery popups as Resolved.Feb 28 2021, 11:40 PM
gerritbot added a comment.Mar 2 2021, 8:30 PM

Change 650558 merged by jenkins-bot:
[mediawiki/extensions/GrowthExperiments@master] Remove variant A code

https://gerrit.wikimedia.org/r/650558

ReleaseTaggerBot added a project: MW-1.36-notes (1.36.0-wmf.34; 2021-03-09).Mar 2 2021, 9:00 PM
Maintenance_bot removed a project: Patch-For-Review.Mar 2 2021, 9:11 PM
gerritbot added a comment.Mar 9 2021, 8:37 AM

Change 670096 had a related patch set uploaded (by Kosta Harlan; owner: Kosta Harlan):
[mediawiki/extensions/GrowthExperiments@master] Homepage: Check welcome notice seen preference

https://gerrit.wikimedia.org/r/670096

gerritbot added a project: Patch-For-Review.Mar 9 2021, 8:37 AM
gerritbot added a comment.Mar 9 2021, 9:09 AM

Change 670107 had a related patch set uploaded (by Kosta Harlan; owner: Kosta Harlan):
[mediawiki/extensions/GrowthExperiments@wmf/1.36.0-wmf.34] Homepage: Check welcome notice seen preference

https://gerrit.wikimedia.org/r/670107

gerritbot added a comment.Mar 9 2021, 9:11 AM

Change 670096 merged by jenkins-bot:
[mediawiki/extensions/GrowthExperiments@master] Homepage: Check welcome notice seen preference

https://gerrit.wikimedia.org/r/670096

gerritbot added a comment.Mar 9 2021, 9:44 AM

Change 670107 merged by jenkins-bot:
[mediawiki/extensions/GrowthExperiments@wmf/1.36.0-wmf.34] Homepage: Check welcome notice seen preference

https://gerrit.wikimedia.org/r/670107

ReleaseTaggerBot edited projects, added MW-1.36-notes (1.36.0-wmf.35; 2021-03-16); removed MW-1.36-notes (1.36.0-wmf.34; 2021-03-09).Mar 9 2021, 10:00 AM
Maintenance_bot removed a project: Patch-For-Review.Mar 9 2021, 10:10 AM
MBinder_WMF added a project: Growth-Team-Filtering.Apr 15 2021, 6:51 PM
• Rileych removed a project: Growth-Team-Filtering.Apr 20 2021, 4:45 PM
• Rileych closed this task as Resolved.May 4 2021, 1:23 PM
• Rileych subscribed.

Kosta and I are closing this. Reopen if you need to!

Tgr mentioned this in T288022: Support multidimensional user variants in GrowthExperiments.Aug 4 2021, 1:15 AM
RHo closed subtask T246533: Variant tests: "initiation part 2" test (C vs. D) as Resolved.Oct 13 2021, 1:39 PM
kostajh closed subtask T235933: Variant tests: A/B/C testing capability as Resolved.Mar 9 2022, 8:35 PM
kostajh closed subtask T246875: Variant tests: feature suggested edits (E vs. F vs. G) as Declined.Sep 26 2022, 10:29 AM
Sgs subscribed.Dec 20 2022, 10:51 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits