TEST COMPLETE.
SUMMARY: Variant B yields more interaction, navigation, and clicking, but only on desktop. On mobile, the variants perform the same, with Variant B leading to less clicking. See full results here.
This is a variant test the Growth team intends to run involving the newcomer tasks feature.
Name of test: initiation
Component: start module / suggested edits module
Goal: find out whether users are more likely to engage with the suggested edits module and select articles when it is already there in front of them when they first arrive on the homepage, or if it is more engaging when they have to step through the intro overlays before seeing suggestions.
Variant A: (status quo) users click a button in the start module to initiate the suggested edits module, and proceed through overlays.
Variant B: suggested edits module is already present on the homepage the first time a user visits, just as if they had already initiated it without selecting any topics.
Metrics: Rate of any clicks in module, rate of article navigation, rate of article selection.
Length: TBD
- Code for variant test
- QA for test
- Design review for test
- PM review for test
- Deploy test
- Validate test in production (@Etonkovidova to post a set of usernames and their variant assignments)
- Validate test assignments recorded correctly in database (@nettrom_WMF to use @Etonkovidova's list to validate database)
- Analyze test results