Background
Our draft hypothesis is: If we make the article search bar more prominent, we will increase the number of users who initiate searches by 8%, possibly leading to a 1% increase in search retention rate for logged out users. Because we don't plan to A/B test this navigation change, we want to have a baseline to compare against. We've drafted metrics, and want to calculate baselines in advance of the feature being deployed in mid February.
Task
**The time period for the baseline can be the 15 days immediately preceding the beginning of Phased release. The navigation changes will release mid February, and we'll do 15 day analysis.
- GR 2.2 No more than 5% increase in app uninstalls (vs baseline)
- CR 3.1 Did account creations increase as a result of the Profile menu being accessible from all screens? (Baseline of 15 days before vs Experiment Date Range)
Open questions
- For engineers: What is the lift to add tracking for pageviews / unique user? If we don't have this, we can't prove that our features cause higher pageviews.
- It's a large lift, but we may be able to accomplish it in phases if we just add impressions for article view, and only the sources that we need for upcoming features.
- For engineers: is it more lightweight if we only add article view sources for Places & History so we can track their moves? (Do a first phase of T374036)
- Yes
- For Shay: Can we access app uninstall data from App store connect?
- Yes